Website Name: ConnectiCare| Price Transparency Machine Readbale files This folder has the data for the link: https://transparency.connecticare.com/INN ____ Index.json files were downloaded from this site. Details of each one is given below: ---------------------------------------------Detials---------------------------------------------------------------------- Folder1 reporting_entity_type: Health Insurance Issuer reporting_entity_name: Connecticare 73 links for json.gz were found in ./2022-10-01_Connecticare_CCI-ASO_index.json As these links are all not have a .json.gz ending, instead some links leads to other webpages with nothing to download, so we will filter the links from which we can get the data. All the downloadable links are also written to this file: 2022-10-01_Connecticare_CCI-ASO_index.txt All the downloaded file are extracted from .json.gz to .json and then converted into .csv. After conversion the .json files are deleted to save memory. --------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------Detials---------------------------------------------------------------------- Folder2 reporting_entity_type: EmblemHealth reporting_entity_name: OBS Health Plan - CCI ASO 1 links for json.gz were found in ./2022-10-01_OptumBH_CCI_ASO_index.jsonn As these links are all not have a .json.gz ending, instead some links leads to other webpages with nothing to download, so we will filter the links from which we can get the data. All the downloadable links are also written to this file: 2022-10-01_OptumBH_CCI_ASO_index.txt All the downloaded file are extracted from .json.gz to .json and then converted into .csv. After conversion the .json files are deleted to save memory. --------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------Detials---------------------------------------------------------------------- Folder3 reporting_entity_type: EmblemHealth reporting_entity_name: OBS Health Plan - CCI ASO 1 links for json.gz were found in ./2022-10-01_OptumBH_CCI_FI_index.json As these links are all not have a .json.gz ending, instead some links leads to other webpages with nothing to download, so we will filter the links from which we can get the data. All the downloadable links are also written to this file: 2022-10-01_OptumBH_CCI_FI_index.txt All the downloaded file are extracted from .json.gz to .json and then converted into .csv. After conversion the .json files are deleted to save memory. --------------------------------------------------------------------------------------------------------------------------- ---------------------------------------------Detials---------------------------------------------------------------------- Folder4 reporting_entity_type: EmblemHealth reporting_entity_name: OBS Health Plan - CCI ASO 1906 links for json.gz were found in ./2022-11-18_Connecticare_CCI_IDP_index.json As these links are all not have a .json.gz ending, instead some links leads to other webpages with nothing to download, so we will filter the links from which we can get the data. All the downloadable links are also written to this file: 2022-11-18_Connecticare_CCI_IDP_index.txt All the downloaded file are extracted from .json.gz to .json and then converted into .csv. After conversion the .json files are deleted to save memory. --------------------------------------------------------------------------------------------------------------------------- --------------------------------------------------------------------------------------------------------------------------- The .csv files are the actual data ! for the codes either check out the main.py or final_script.ipynb