{"text_format":"1","workbook":"xlsx","n_sheets":17,"sheets":["Instructions","Review Summary","Accreditation","Program Attestation","ECP","Category Class Drug Count","Formulary Outlier","Clinical Appropriateness","Benefit Cost Sharing","Non-Discrimination Cost Sharing","Service Area","QIS","Drop Down","MOOP Details","Tukey Outlier Overview","Non-Discrimination Guidance","Actuarial Value Guidance"],"not_rendered":{"charts":0,"images":1,"macros":1,"external_links":2,"defined_names":10,"comments":0,"pivot_tables":0},"unopened":[],"bounds":{"document_bytes":16777216,"sheet_cells":100000,"rows_first":2000,"rows_last":500,"rows_between":2000,"halvings":0,"cell_chars":16384,"cell_head_chars":4096},"cells_cut":0,"cells_raw":0,"read":"whole","date_system":"1900"}

{"sheet":"Instructions","index":0,"n_rows":18,"n_cols":3,"rows_kept":18,"cut":false,"hidden":false,"merged":[[17,2,17,3],[2,1,2,3],[11,1,13,1],[11,2,11,3],[12,2,12,3],[13,2,13,3],[14,2,14,3],[15,2,15,3],[8,1,8,3],[9,2,9,3],[10,2,10,3],[7,1,7,3],[1,1,1,3],[5,1,5,3],[3,1,3,3],[4,1,4,3],[16,2,16,3]]}
[]
[null,"Instructions for Using the Review Process Guide (2024 v1.2)"]
[null,"Use of tools by state regulators is optional. States may use any tools or parts of tools they believe will assist in their review process. These tools are methods for reviewing for compliance with specific standards. Any alternative state review methods must be consistent with federal standards, but need not be identical to the approach methods via these tools."]
[null,"Use of tools by issuers is optional. Issuers are encouraged to use these tools proactively before submitting their QHP applications and can also reference them when a state or federal regulator requests corrections after a review that relied on these tools. However, please note that issuers must respond to any deficiencies identified by a state or federal regulator even if an identified issue is different than the results obtained using these tools. "]
[null,"Use of these tools by CMS and states. CMS plans to use these tools in Federally-Facilitated Exchanges (FFEs) for those standards that are specific to certification of QHPs. This includes certification standards for Federally-facilitated Small Business Health Options Program (FF-SHOP). For more information on the FFE certification process and related standards, please see the \"2024 Letter to Issuers in the Federally-facilitated Exchanges” available on the CCIIO website under Regulations and Guidance.\n\nIssuers in states performing plan management functions may contact their state regulator to determine if one or more of these review tools will be part of their review processes. CMS will review and confirm the state's QHP certification recommendations and make final QHP certification decisions. CMS will work closely with states that are performing plan management functions to coordinate this process."]
[null,"In prior plan years, this tool was part of the Master Review Tool. To reduce the number of tabs within each tool, all of the review standards and sample review methodologies has been pulled out of the Master Review Tool and can now be found in this file, the Review Process Guide."]
[]
[null,"Tabs Within the Review Process Guide"]
[null,"There are a number of tabs in this workbook, the following explains how to use them."]
[null,"Tab","Use/Explanation"]
[null,"Review Summary","This tab keeps track of whether each plan has met each of the standards. This is not a comprehensive list of all review standards. The cells are empty, so you can enter notes, or \"Met\" or \"Not Met\" based on the results you found for each review area."]
[null,"Standard Review Tabs","These tabs (as listed on the Review Summary tab) contain proposed step by step validation steps for reviewing a specific standard. When a stand-alone tool is available to assist in the analysis, this is explained on the individual tabs. You may go through each of the tabs to determine if the standards have been met."]
[null,null,"The column headers on each tab will indicate the level of review. For example, the Accreditation review should be completed for each issuer, while the cost sharing review should be completed for each plan. After you indicate the result of the review on the standard review tabs, you can manually transfer the results into the \"Review Summary\" tab for each plan."]
[null,null,"For each standard, you can go through all of the steps and keep track of whether they have been met or not met, or make any necessary notes, and then make a final \"Met\" or \"Not Met\" designation for the review at the top of the tab. Keep in mind that not all steps may be relevant for every plan, for example some steps may apply only to silver plans, or only to plans within the Small Group Market. "]
[null,"MOOP Details","This tab contains a table explaining which MOOP fields should be compared with the threshold depending on the following plan attributes: if you're looking at the Individual or Family threshold, if there are multiple in network tiers, if the medical and drug MOOPs are integrated, and if there is an in network MOOP or if in network is \"Not Applicable\" because a combined in and out of network MOOP is being used instead."]
[null,"Tukey Outlier Overview","The Tukey Outlier Test is used to conduct the Non-Discrimination cost sharing outlier review (see \"Non-Discrimination\" tab for more information) and the Formulary Outlier review (see \"Formulary Outlier\" tab for more information). The Tukey Outlier Method is described in more detail on this tab."]
[null,"Non-Discrimination Guidance","The intent of this guidance is to clarify non-discrimination standards and provide examples of benefit design that are potentially discriminatory under the Affordable Care Act."]
[null,"Actuarial Value Guidance","The purpose of this guidance is to document the review of alternate AV calculation methods, and to outline the review of AV for both metal tier level plans and Cost Sharing Reduction (CSR) silver plan variations."]

{"sheet":"Review Summary","index":1,"n_rows":25,"n_cols":3,"rows_kept":25,"cut":false,"hidden":false,"merged":[[0,0,0,1],[24,0,24,1]]}
["Review Summary"]
[null,null,"Validation Results"]
[null,"HIOS Issuer ID:"]
[null,"Type of Plan:"]
[null,"Plan ID:"]
[null,"Plan Benefit Workbook Name, Benefits Package:"]
[null,"Formulary ID:"]
[null,"Network ID:"]
[null,"Service area ID:"]
["Section/Standard","Function of Review"]
["Accreditation","Ensure the issuer is accredited by NCQA or URAC, or is assumed to be working towards accreditation."]
["Program Attestation","Confirm submission of program attestations."]
["ECP","Ensure issuers have ECPs, where available, that meet the policy standards."]
["Category Class Drug Count","Ensure compliance with EHBs and check for discrimination by counting drugs in each USP category and class."]
["Non-Discrimination Formulary Outlier","Identifies plans with an unusually large number of drugs that require step therapy or prior authorization in 28 USP classes."]
["Non-Discrimination Clinical Appropriateness","Analyzes the availability of covered drugs associated with nine conditions as recommended in clinical guidelines, to ensure that issuers are offering a sufficient type and number of drugs."]
["Benefit Cost Sharing - MOOP","Check in-network out-of-pocket maximum costs for individual and family EHB coverage against the annual dollar limits."]
["Benefit Cost Sharing - CSR","Ensure the cost sharing plan variations meet all requirements."]
["Benefit Cost Sharing - Standardized Options","Ensures standardized options meet all requirements."]
["Benefit Cost Sharing - Catastrophic Plans","Ensure catastrophic plans meet all requirements."]
["Non-Discrimination Cost Sharing","Perform an outlier analysis on selected benefits cost-sharing."]
["Service Area","Confirm that issuers include full counties or have a justifiable reason for partial counties."]
["Quality Improvement Strategy (QIS)","Assess whether issuers' QIS submissions meet the fundamental QIS requirements as specified in Section 1311 (g) of the Affordable Care Act and as explained in the QIS Technical Guidance and User Guide for the 2024 Plan Year."]
[]
["OVERALL PLAN VALIDATION"]

{"sheet":"Accreditation","index":2,"n_rows":14,"n_cols":6,"rows_kept":14,"cut":false,"hidden":false,"merged":[[0,0,0,4]]}
["Accreditation Review Process Steps"]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"SELECT REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
[1,null,"If the issuer is new to the Exchange for 2024 then review if the issuer is accredited or working towards accreditation. "]
[1,"a",null,"Ensure the issuer is accredited by NCQA, URAC, or AAAHC. If yes, mark as \"Met.\" If no, move to review 2b. "]
[1,"b",null,"If the issuer is not accredited, advise the issuer that they need to be working towards accreditation. Issuers should be scheduling or plan to schedule an accreditation review with NCQA, URAC, or AAAHC. Mark as \"Met.\" "]
[2,null,"If the issuer was part of the Exchange last year, but this is not their 4th year of QHP certification, then review if the issuer is accredited."]
[2,"a",null,"If the issuer reports Marketplace/Exchange, Commercial or Medicaid accreditation, ensure that the issuer is accredited by NCQA, URAC, or AAAHC, and that the policies and procedures underlying their accreditation are the same as those for their QHP. If yes, mark as “Met.”"]
[2,"b",null,"If the issuer does not report Exchange/Marketplace, Commercial or Medicaid accreditation by NCQA, URAC or AAAHC, or reports some other kind of accreditation not listed here, then mark as \"Not Met.\""]
[3,null,"If the issuer is participating on the Exchange for the fourth year (or more) then review if the issuer meets year 4 requirements."]
[3,"a",null,"If the issuer is accredited by NCQA or URAC, ensure that the issuer reports Marketplace/Exchange accreditation. If yes, move to review 3b. If the issuer does not report Marketplace/Exchange accreditation, then mark as “Not Met.”"]
[3,"b",null,"If the issuer reports an acceptable accreditation status, mark as “Met”. Acceptable statuses for year 4 issuers are: AAAHC-Accredited; NCQA-Excellent, Commendable, Accredited, Provisional; URAC-Full, Conditional. If the issuer does not report an acceptable accreditation status, mark as “Not Met.” "]

{"sheet":"Program Attestation","index":3,"n_rows":18,"n_cols":6,"rows_kept":18,"cut":false,"hidden":false,"merged":[[0,0,0,4]]}
["Program Attestation Process Steps"]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"SELECT REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
[1,null,"Verify QHP and SADP program attestations response.",null,"Attestation "]
[1,"a",null,"Verify the issuer responded to the QHP and SADP Program Attestations subsection. If the issuer responds “Yes,” it complies; go to the next review. If the issuer responds “No,” it does not comply; mark as “Not Met” and continue to the next review."]
[null,"b",null,"For “QHP” and “SADP” issuers, verify the issuer responded to the Network Adequacy/Essential Community Provider attestations required of both Medical QHP and SADP issuers. If the issuer responds “Yes” or “No,” it complies; continue to the next review. "]
[2,null,"Verify Medical QHP-only program attestations response.",null,"Attestation"]
[2,"a",null,"Using the issuer type information, determine how the issuer should respond. “QHP Only” and “Dual Issuers” issuers must attest “Yes” to this subsection. “SADP Only” issuers may attest “Yes,” “No,” or “N/A.”"]
[2,"b",null,"For “QHP Only” and “Dual Issuers” issuers, verify the issuer responded to the Medical QHP-only Program Attestations subsection. If the issuer responds “Yes,” it complies; go to next review. If the issuer responds “No,” it does not comply; mark as “Not Met” and continue to next review."]
[2,"c",null,"For “SADP Only” issuers, verify the issuer responded to the Medical QHP-only Program Attestations subsection. If the issuer responds “Yes,” “No,” or “N/A,” it complies; go to the next review."]
[3,null,"Verify SADP-only program attestations response.",null,"Attestation"]
[3,"a",null,"Using the issuer type information, determine how the issuer should respond. \"SADP Only” issuers and “Dual Issuers” issuers must attest “Yes” to this subsection. “QHP Only” issuers may attest “Yes,” “No,” or “N/A.”"]
[3,"b",null,"For “SADP Only” and “Dual Issuers” issuers, verify the issuer responded to the SADP-only Program Attestations subsection. If the issuer responds “Yes,” it complies; go to the next review. If the issuer responds “No,” it does not comply; mark as “Not Met” and continue to the next review."]
[3,"c",null,"For “QHP Only” issuers, verify the issuer responded to the SADP-only Program Attestations subsection. If the issuer responds “Yes,” “No,” or “N/A,” it complies; go to the next review."]
[4,null,"Verify optional program attestations response."," ","Attestation"]
[4,"a",null,"Verify the issuer responded to the Optional Program Attestations subsection. If the issuer responds “Yes,” it complies. Write notes where applicable, finalize the review, and end the Program Attestation review. If the issuer responds “No,” verify the issuer has submitted a justification form. If no justification form has been provided, mark as “Not Met”, write notes where applicable, finalize the review, and end the Program Attestation review."]

{"sheet":"ECP","index":4,"n_rows":63,"n_cols":6,"rows_kept":63,"cut":false,"hidden":false,"merged":[[57,0,58,0],[57,1,58,1],[57,2,58,2],[57,4,58,4],[46,0,48,0],[46,1,48,1],[46,2,48,2],[46,4,48,4],[51,0,52,0],[51,1,52,1],[51,2,52,2],[51,4,52,4],[42,0,43,0],[42,1,43,1],[42,2,43,2],[42,4,43,4],[36,0,38,0],[36,1,38,1],[36,2,38,2],[36,4,38,4],[40,0,41,0],[40,1,41,1],[40,4,41,4],[40,2,41,2],[0,0,0,4],[2,0,2,4],[13,0,14,0],[13,1,14,1],[13,2,14,2],[13,4,14,4],[16,0,17,0],[16,2,17,2],[16,4,17,4],[16,1,17,1],[32,0,33,0],[32,1,33,1],[32,2,33,2],[32,4,33,4],[20,0,21,0],[20,1,21,1],[20,2,21,2],[20,4,21,4],[30,0,31,0],[30,1,31,1],[30,2,31,2],[30,4,31,4]]}
["Essential Community Providers (ECP) Review Process Steps"]
[]
["There is a separate tool available to assist in the ECP review. The following explains the steps followed in the tool."]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"Plan ID:"]
[null,null,null,null,"Network ID:"]
[null,null,null,null,"Service area ID:"]
[null,null,null,null,"SELECT REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
[1,null,"Determine whether the issuer is a general standard issuer or an alternate standard issuer."]
[1,"a",null,"If the answer to “Is this an Alternate ECP Standard Issuer?” is No on the User Control tab of the ECP/NA Template, the issuer is a general ECP standard issuer.","ECP/NA Template"]
[1,"b",null,"If the answer to “Is this an Alternate ECP Standard Issuer?” is Yes on the User Control tab of the ECP/NA Template, the issuer is an alternate ECP standard issuer.","ECP/NA Template"]
[1,"c",null,"If the issuer submitted an ECP Write-In Worksheet, compare the answer to “Are you an alternate ECP standard issuer?” on the ECP Write-In Worksheet to the response provided in the ECP/NA Template. If the responses do not match, mark as “Not Met” and end the ECP review.","ECP Write-In Worksheet"]
[null,null,null,"If the responses are the same, proceed to review 2."]
[2,null,"Verify the issuer has identified ECPs for each of its networks."]
[2,"a",null,"If all entries in the ECP/NA Template are dummy values, confirm that the issuer has submitted an ECP supplemental response. Use the ECP Supplemental Response Reviewer Guide to evaluate the issuer’s ECP supplemental response.","ECP/NA Template, ECP Write-In Worksheet, and supporting document"]
[null,null,null,"If the justification satisfactorily addresses all elements of the supplemental response, mark as “Not Met”, add comments, and end the ECP review."]
[2,"c",null,"If all entries are dummy values and the justification does not satisfactorily address all elements of the supplemental response, mark as “Not Met”, add comments, and end the ECP review.","ECP/NA Template, ECP Write-In Worksheet, and supporting document"]
[2,"c",null,"If all entries are dummy values and no justification is provided, mark as “Not Met”, add comments, finalize the section, and end the ECP review.","ECP/NA Template, ECP Write-In Worksheet, and supporting document"]
[2,"d",null,"If ECPs are provided for some but not all networks, use the ECP Supplemental Response Reviewer Guide to verify the issuer has provided a justification (Supplemental Response Form) for the networks without ECPs.","ECP/NA Template, ECP Write-In Worksheet, and supporting document"]
[null,null,null,"If the justification satisfactorily addresses all supplemental response elements, mark as “Not Met”, add comments, and go to the next review."]
[2,"e",null,"If ECPs are provided for some but not all networks and the justification does not satisfactorily address all supplemental response elements, mark as “Not Met”, add comments, and go to the next review.","ECP/NA Template, ECP Write-In Worksheet, and supporting document"]
[2,"f",null,"If ECPs are provided for some but not all networks and no justification is provided, mark as “Not Met”, add comments, and go to the next review.","ECP/NA Template, ECP Write-In Worksheet, and supporting document"]
[3,null,"Perform checks for data submission errors."]
[3,"a",null,"Review the Service Area IDs and Network IDs in the Plans in the Analyzer data to confirm that the same combination is not used for both medical and dental plans. If the same Service Area ID and Network ID combination is used for both plan types, mark as “Not Met”, add comments, and end the ECP review.","Plans & Benefits Template"]
[3,"b",null,"Review the ECP/NA Template data to determine whether data integrity issues exist that would prevent completion of the ECP review. If data integrity issues exist and you cannot correct them, mark as “Not Met”, add comments, and end the ECP review.","ECP/NA Template and ECP Write-In Worksheet"]
[3,"c",null,"If no data integrity issues exist, then go to review 4, if the issuer is a general ECP standard issuer, or go to review 5, if the issuer is an alternate ECP standard issuer.","ECP/NA Template and ECP Write-In Worksheet"]
[3,"d",null,"If data integrity issues exist and you can correct them, clean up the data. Go to review 4, if the issuer is a general ECP standard issuer. Go to review 5, if the issuer is an alternate ECP standard issuer.","ECP/NA Template and ECP Write-In Worksheet"]
[4,null,"If the issuer is a general ECP standard issuer, determine whether it has met the threshold—35 percent of available ECPs—for all networks in all proposed service areas."]
[4,"a",null,"If you found no data integrity issues, run the ECP Individual Tool and record the ECP review results from the output. If the issuer meets the 35 percent ECP threshold for all network–service area combinations, add comments and go to review step 4e.","ECP Tool"]
[null,null,null,"If the issuer does not meet the 35 percent ECP threshold for all network–service area combinations, go to review step 4c."]
[4,"b",null,"If you found data integrity issues, clean up the data and run the ECP Individual Tool. If the issuer meets the 35percent ECP threshold for all network–service area combinations, add comments and go to review step 4e.","ECP/NA Template, Plans in the Analyzer report, ECP Tool"]
[null,null,null,"If the issuer does not meet the ECP threshold for all network–service area combinations, go to review step 4c."]
[4,"c",null,"If the 35 percent threshold is met for some but not all issuer network–service area combinations, document the review results, write comments as needed, and go to review step 4e.","ECP Tool"]
[4,"d",null,"If the 35 percent threshold is not met for any issuer network-service area combinations, document the review results, add comments as needed, and go to review step 4e.","ECP Tool"]
[4,"e",null,"Check the ECP question. If the issuer met the 35 percent threshold and responds “Yes” to the ECP question, finalize the ECP section and end the ECP review."]
[null,null,null,"If the issuer met the 35 percent threshold and responds “No” to the ECP question, go to review 7."]
[null,null,null,"If the issuer did not meet the 35 percent threshold and responds “Yes” or “No,” go to review 6."]
[5,null,"If the issuer is an alternate standard issuer, determine whether the issuer has met the ECP threshold—35 percent of available ECPs—for all networks in all proposed service areas and has provider locations in HPSAs and low-income ZIP codes in all service areas."]
[5,"a",null,"If you found no data integrity issues in review 3, run the ECP Individual Tool and record the ECP review results from the output. If the issuer meets the 35 percent ECP threshold for all network–service area combinations, add comments as needed and go to step 5e.","ECP tool"]
[null,null,null,"If the issuer does not meet the 35 percent ECP threshold for all network–service area combinations, go to review step 5c."]
[5,"b",null,"If you found data integrity issues, clean up the ECP data and run the ECP Individual Tool. If the issuer meets the ECP threshold for all network–service area combinations, document the review results, add comments as needed, and go to review step 5e.","ECP/NA Template, ECP Write-In Worksheet, Plans in the Analyzer report, and ECP Tool"]
[null,null,null,"If the issuer does not meet the 35 percent ECP threshold for all network–service area combinations, add comments as needed and go to review step 5c."]
[5,"c",null,"If the 35 percent threshold is met for some but not all issuer network–service area combinations, record the review results, add comments as needed, and go to review step 5e.","ECP Tool"]
[5,"d",null,"If the 35 percent threshold is not met for any issuer network–service area combination, document the review results, add comments as needed, and go to review step 5e.","ECP Tool"]
[5,"e",null,"Check the ECP question. If the issuer met the 35 percent threshold and responds “Yes” to the ECP question, finalize the ECP section and end the ECP review."]
[null,null,null,"If the issuer met the 35 percent threshold and responds “No,” go to review 7."]
[null,null,null,"If the issuer did not meet the 35 percent threshold and responds “Yes” or “No” to the ECP question, go to review 6."]
[6,null,"Determine whether the ECP supplemental response is satisfactory for issuers not meeting the 35 percent threshold."]
[6,"a",null,"Review the issuer’s ECP Supplemental Response Form (justification).","Supporting documents"]
[6,"b",null,"Using the ECP Supplemental Response Reviewer Guide, document your findings from the review of the ECP Supplemental Response Form.","Supporting documents"]
[null,null,null,"If the issuer’s network(s) did not meet the 35 percent threshold, but the issuer’s ECP supplemental response satisfactorily addresses all supplemental response elements, mark as “Not Met”, add comments as needed, finalize the review, and end the ECP review."]
[6,"c",null,"If the issuer’s network(s) did not meet the 35 percent threshold and the issuer’s ECP supplemental response does not satisfactorily address all supplemental response elements, mark as “Not Met”, add comments, and end the ECP review.","Supporting documents"]
[6,"d",null,"If the issuer’s network(s) did not meet the 35 percent threshold and no justification is provided, mark as “Not Met”, add comments, and end the ECP review.","Supporting documents"]
[7,null,"For issuers meeting the 35 percent threshold that answered “No” to the ECP question, determine whether the ECP supplemental response is satisfactory."]
[7,"a",null,"Review the ECP Supplemental Response Form (justification).","Supporting documents"]
[7,"b",null,"Use the ECP Supplemental Response Reviewer Guide to evaluate and document the issuer’s ECP supplemental response.","Supporting documents"]
[null,null,null,"If the 35 percent threshold is met and the answer to the ECP question is “No,” and the justification satisfactorily addresses all supplemental response elements, end the ECP review."]
[7,"c",null,"If the 35 percent threshold is met and the answer to the ECP question is “No,” and the justification does not satisfactorily address all supplemental response elements, mark as “Not Met”, add comments, and end the ECP review.","Supporting documents"]
[7,"d",null,"If the 35 percent threshold is met and the answer to the ECP question is “No,” and no justification is provided, mark as “Not Met”, add comments, and end the ECP review.","Supporting documents"]
[7,"c",null,"If the 35 percent threshold is met and the answer to the ECP question is “Yes,” and the justification does not satisfactorily address all supplemental response elements, mark as \"Not Met\", add comments, and end the ECP Review.","Supporting documents"]
[7,"d",null,"If the 35 percent threshold is met and the answer to the ECP question is “Yes,” and no justification is provided, mark as \"Not Met\", add comments, and end the ECP Review.","Supporting documents"]

{"sheet":"Category Class Drug Count","index":5,"n_rows":31,"n_cols":6,"rows_kept":31,"cut":false,"hidden":false,"merged":[[27,0,29,0],[27,1,29,1],[27,2,29,2],[27,4,29,4],[21,0,25,0],[21,1,25,1],[21,2,25,2],[21,4,25,4],[19,0,20,0],[19,1,20,1],[19,2,20,2],[0,0,0,4],[2,0,2,4]]}
["Category Class Count Review Process Steps"]
[]
["There is a stand-alone tool available to assist in the category class count review. The following explains the steps followed in the tool."]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"Formulary ID:"]
[null,null,null,null,"Drug list ID:"]
[null,null,null,null,"SELECT REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
[1,null,"Create a list of RXCUIs included in the drug list under review."]
[1,"a",null,"For each RXCUI, if the RXCUI has a Tier Level not equal to “NA” in the drug list under review, add the RXCUI to the list of RXCUIs for review.","RXCUI, Tier Level"]
[null,null,null,"RXCUIs with a Tier Level equal to “NA” are not included in the given drug list."]
[2,null,"Map RXCUIs to categories and classes by using the EHB Rx Crosswalk."]
[2,"a",null,"For each RXCUI being reviewed, if the RXCUI is included in the EHB Rx Crosswalk, map the RXCUI to one or more categories and classes. If the RXCUI is not included in the EHB Rx Crosswalk, ignore the RXCUI.","RXCUI, EHB Rx Crosswalk"]
[3,null,"Convert the RXCUIs to chemically distinct drug identifiers by using the EHB Rx Crosswalk."]
[3,"a",null,"For each RXCUI, if the RXCUI is included in the EHB Rx Crosswalk, map the RXCUI to a chemically distinct drug identifier. If the RXCUI is not included in the EHB Rx Crosswalk, ignore the RXCUI.","RXCUI, EHB Rx Crosswalk"]
[4,null,"Count the number of chemically distinct drugs in each category and class."]
[4,"a",null,"Count the number of unique chemically distinct drug identifiers in each category and class."]
[5,null,"Compare the number of chemically distinct drugs in each category and class with the number in the EHB benchmark."]
[5,"a",null,"For each category and class, compare the number of unique chemically distinct drug identifiers in the drug list with the number of chemically distinct drugs in the EHB benchmark."]
[null,null,null,"If the category does not have any classes, perform the comparison at the category level."]
[5,"b",null,"For each category and class, if the EHB benchmark is met, no further review is required.","EHB benchmark"]
[null,null,null,"For each category and class, if the count of the chemically distinct drug identifiers in the drug list is less than the greater of"]
[null,null,null,"     one drug or"]
[null,null,null,"     the number of chemically distinct drugs in the EHB benchmark in the given category and class,"]
[null,null,null,"flag the category and class in the drug list for further review."]
[6,null,"Examine justification documents for categories and classes requiring further review."]
[6,"a",null,"For each flagged category and class in each drug list needing further review, consider the following:","Justification documents"]
[null,null,null,"If the issuer submitted a Formulary Justification Template that includes one of the preapproved reasons for having an inadequate number of drugs in the given category and class, consider the category and class to have a valid justification and repeat this review step for the next flagged category and class."]
[null,null,null,"If the issuer’s Formulary Justification Template includes a reason other than one of those preapproved for having an inadequate number of drugs in the given category and class, or if the issuer submitted drug count justification documents other than the Formulary Justification Template, research the provided justifications to confirm their validity. This research should be performed by a pharmacist when appropriate."]
[6,"b",null,"If the issuer provided no valid justification for a flagged category and class in a drug list needing further review, flag all plans associated with the drug list as “Not Met”."]

{"sheet":"Formulary Outlier","index":6,"n_rows":42,"n_cols":6,"rows_kept":42,"cut":false,"hidden":false,"merged":[[28,0,30,0],[28,1,30,1],[28,2,30,2],[28,4,30,4],[39,0,40,0],[39,1,40,1],[39,2,40,2],[39,4,40,4],[24,0,27,0],[24,1,27,1],[24,2,27,2],[24,4,27,4],[0,0,0,4],[2,0,2,4],[11,0,12,0],[11,1,12,1],[11,2,12,2],[11,4,12,4]]}
["Formulary Outlier Process Steps"]
[]
["There is a stand-alone tool available to assist in the formulary outlier review. The following explains the steps followed in the tool."]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"Formulary ID:"]
[null,null,null,null,"Drug list ID:"]
[null,null,null,null,"SELECT REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
[1,null,"For each drug list, create a list of RXCUIs  included in the drug classes being reviewed for formulary outlier non-discrimination."]
[1,"a",null,"For each RXCUI, if the RXCUI has a Tier Level not equal to “NA” in the drug list under review, add the RXCUI to the list of RXCUIs for potential review.","RXCUI, Tier Level"]
[1,"b",null,"If the RXCUI maps to the drug classes being reviewed, keep the RXCUI in the list of RXCUIs for review.","RXCUI"]
[null,null,null,"If the RXCUI does not map to the drug class being reviewed, remove the RXCUI from the list of RXCUIs for review."]
[2,null,"Convert the RXCUIs to chemically distinct drug identifiers."]
[null,null,null,"For each RXCUI being reviewed, map the RXCUI to a chemically distinct drug identifier by using the EHB Rx Crosswalk.","RXCUI, EHB Rx Crosswalk"]
[3,null,"For each drug list, count the number of chemically distinct drugs in the drug class being reviewed without a prior authorization or step therapy requirement."]
[3,"a",null,"For each chemically distinct drug identifier, determine whether any of the RXCUIs mapped to the chemically distinct drug identifier have either a prior authorization or step therapy requirement. If any of the RXCUIs mapped to the chemically distinct drug identifier have neither requirement, consider the chemically distinct drug identifier “unrestricted.”","RXCUI, Prior Authorization Required, Step Therapy Required"]
[3,"b",null,"Count the number of unique, unrestricted chemically distinct drug identifiers in each category and class.","RXCUI"]
[4,null,"Remove drugs lists that do not map to a plan.",null," "]
[4,"a",null,"Determine the drug lists that map to a plan. Map the formulary ID from the Prescription Drug template to the formulary IDs on the Plans & Benefits template. Exclude the drug lists that do not map to a plan in the steps that follow.","Formulary ID, State Code, Issuer ID, Plan ID"]
[5,null,"Remove drug lists that map to a suppressed or withdrawn plan."]
[5,"a",null,"Determine the drug lists that map to a plan. Map the formulary ID from the Prescription Drug template to the formulary IDs on the Plans & Benefits template. Exclude the drug lists that do not map to a plan in the steps that follow.","Formulary ID, State Code, Issuer ID, Plan ID"]
[5,"b",null,"Determine the plans that are suppressed and withdrawn. Map plans to suppression and withdrawn status. Exclude the drug lists that only map to a suppressed or withdrawn plan in the steps that follow.","Plan ID, Suppression Status, Withdrawn Status"]
[6,null,"For each drug list, cap the count of unrestricted chemically distinct drugs by the number of chemically distinct drugs in the EHB benchmark for the drug class being reviewed."]
[6,"a",null,"For the drug class being reviewed, if the number of chemically distinct drugs in the EHB benchmark is equal to 0, find the capped count of unrestricted drugs by taking the minimum of","EHB benchmark"]
[null,null,null,"¿ one, or"]
[null,null,null,"¿ the number of unrestricted grouping numbers."]
[null,null,null,"If not, skip this step."]
[6,"b",null,"If the capped count was determined in step a, skip this step. Otherwise, find the capped count of unrestricted drugs by taking the minimum of the number of","EHB benchmark"]
[null,null,null,"¿ chemically distinct drugs in the EHB benchmark in the drug class being reviewed, or"]
[null,null,null,"¿ unrestricted chemically distinct drug identifiers."]
[7,null,"If this is the initial outlier calculation, calculate the state-level lower outlier threshold of the count of unrestricted drugs in the drug class being reviewed."]
[7,"a",null,"Using the modified Tukey’s test method, calculate and store the state lower outlier threshold of the count of unrestricted drugs for each state."]
[8,null,"If this is the initial outlier calculation, calculate the national-level lower outlier threshold of the count of unrestricted drugs in the drug class being reviewed."]
[8,"a",null,"Using the modified Tukey’s test method, calculate and store the national lower outlier threshold of the count of unrestricted drugs."]
[9,null,"Determine whether each drug list is a formulary low outlier in the drug class being reviewed."]
[9,"a",null,"For each drug list, if the count of unrestricted drugs in the drug class being reviewed is less than the state-level lower outlier threshold, or the national lower outlier threshold, flag the drug list for further review."]
[10,null,"Examine justification documents for drug lists requiring further review."]
[10,"a",null,"If no justification accompanies the drug list, mark the drug list as “Not Met” for the drug class being reviewed."]
[10,"b",null,"If a justification accompanies the drug list, examine the clinical validity of the issuer’s drug list for the drug class being reviewed. In addition, for the drug class marked as \"Not Met\", assess the restrictions applied to all the drugs in the drug class and determine whether each drug is restricted, unrestricted, or not on formulary. Finally, identify how the drug list marked as \"Not Met\" differs from those marked as \"Met\" within the state."]
[null,null,null,"Provide a recommendation regarding whether the justification is acceptable or unacceptable. If the justification is unacceptable, mark the drug list as \"Not Met\" for the drug class being reviewed."]
[10,"c",null,"If the justification is found to be acceptable, assess the drug list to determine whether it meets the criteria referenced in the justification."]

{"sheet":"Clinical Appropriateness","index":7,"n_rows":27,"n_cols":6,"rows_kept":27,"cut":false,"hidden":false,"merged":[[24,0,25,0],[24,1,25,1],[24,2,25,2],[24,4,25,4],[0,0,0,4],[2,0,2,4],[11,0,12,0],[11,1,12,1],[11,2,12,2],[11,4,12,4]]}
["Clinical Appropriateness Review Process Steps"]
[]
["There is a stand-alone tool available to assist in the clinical appropriateness eview. The following explains the steps followed in the tool."]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"Formulary ID:"]
[null,null,null,null,"Drug list ID:"]
[null,null,null,null,"SELECT REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
[1,null,"For each drug list, create a list of RXCUIs included in the drug classes being reviewed for clinical appropriateness."]
[1,"a",null,"For each RXCUI, if the RXCUI has a Tier Level not equal to “NA” in the drug list under review, add the RXCUI to the list of RXCUIs for potential review.","RXCUI, Tier Level"]
[1,"b",null,"If the RXCUI maps to the drug classes being reviewed, keep the RXCUI in the list of RXCUIs for review.","RXCUI"]
[null,null,null,"If the RXCUI does not map to the drug classes being reviewed, remove the RXCUI from the list of RXCUIs for review."]
[2,null,"Convert the RXCUIs to clinically distinct drug identifiers."]
[2,"a",null,"For each RXCUI being reviewed, map the RXCUI to a clinically distinct drug identifier by using the Clinical Appropriateness drug list.","RXCUI"]
[3,null,"For each drug list, count the number of clinically distinct drugs in the drug class being reviewed."]
[3,"a",null,"Count the number of unique clinically distinct drugs in each of the drug classes being reviewed. This is the covered drug count.","RXCUI, Prior Authorization Required, Step Therapy Required"]
[4,null,"For each drug list, count the number of clinically distinct drugs in the drug class being reviewed without a prior authorization or step therapy requirement."]
[4,"a",null,"For each clinically distinct drug identifier, determine whether any of the RXCUIs mapped to the clinically distinct drug identifier have either a prior authorization or step therapy requirement. If any of the RXCUIs mapped to the clinically distinct drug identifier have neither requirement, consider the clinically distinct drug identifier “unrestricted.”","RXCUI, Prior Authorization Required, Step Therapy Required"]
[4,"b",null,"Count the number of unique, unrestricted clinically distinct drug identifiers in each category and class. This is the unrestricted drug count.","RXCUI"]
[5,null,"Determine whether a drug list’s count of drugs is less than the clinically appropriate threshold."]
[5,"a",null,"For each drug list, if the drug count, or unrestricted drug count, in the drug class being reviewed is less than the clinically appropriate threshold flag the drug list for further review."]
[6,null,"Examine justification documents for drug lists requiring further review."]
[6,"a",null,"If no justification accompanies the drug list, flag the drug list as “Not Met” for the drug class being reviewed."]
[6,"b",null,"If a justification accompanies the drug list, examine the clinical validity of the issuer’s drug list for the drug class being reviewed. Finally, identify how the drug list with issuer differs from those without issues within the state."]
[null,null,null,"Provide a recommendation regarding whether the justification is acceptable or unacceptable. If the justification is unacceptable, flag the drug list as being \"Not Met\" for the drug class being reviewed."]
[6,"c",null,"If the justification is found to be acceptable, assess the drug list to determine whether it meets the criteria referenced in the justification."]

{"sheet":"Benefit Cost Sharing","index":8,"n_rows":116,"n_cols":6,"rows_kept":116,"cut":false,"hidden":false,"merged":[[71,2,73,2],[71,4,73,4],[71,0,73,0],[71,1,73,1],[0,0,0,4],[30,0,30,4],[62,0,62,4],[2,0,2,4],[11,0,11,4],[13,0,14,0],[13,1,14,1],[13,2,14,2],[13,3,14,3],[86,0,86,4],[90,0,91,0],[90,1,91,1],[90,2,91,2],[90,3,91,3],[93,0,94,0],[93,1,94,1],[93,2,94,2],[93,3,94,3],[95,0,96,0],[95,1,96,1],[95,2,96,2],[95,3,96,3],[97,0,98,0],[97,1,98,1],[97,2,98,2],[97,3,98,3],[100,0,101,0],[100,1,101,1],[100,2,101,2],[100,3,101,3],[102,0,103,0],[102,1,103,1],[102,2,103,2],[102,3,103,3],[105,0,106,0],[105,1,106,1],[105,2,106,2],[105,3,106,3],[107,0,108,0],[107,1,108,1],[107,2,108,2],[107,3,108,3],[109,0,110,0],[109,1,110,1],[109,2,110,2],[109,3,110,3],[114,0,115,0],[114,1,115,1],[114,2,115,2],[114,3,115,3],[112,0,113,0],[112,1,113,1],[112,2,113,2],[112,3,113,3]]}
["Benefit Cost Sharing Review Process Steps"]
[]
["There is a stand-alone tool available to assist in the cost sharing reviews. The following explains the steps followed in the tool."]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"Plan ID:"]
[null,null,null,null,"SELECT MOOP REVIEW RESULT:  "]
[null,null,null,null,"SELECT COST SHARING REDUCTION (CSR) REVIEW RESULT:  "]
[null,null,null,null,"SELECT CATASTROPHIC PLAN REVIEW RESULT:  "]
[null,null,null,null,"SELECT STANDARDIZED OPTIONS REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
["Perform the Maximum Out of Pocket (MOOP) Review for all plans."]
[1,null,"Determine the appropriate MOOP to compare with the annual dollar limitation specified in regulation."]
[1,"a",null,"Use MOOP Details tab to determine the appropriate MOOP to compare with the annual dollar limitation specified in regulation. The finalized limit for QHPs is $9,450 for individuals and $18,900 for family.","Multiple In Network Tiers?"]
[null,null,null,null,"Medical & Drug Maximum Out of Pocket Integrated? Dental Only Plan; refer to MOOP Details"]
[1,"b",null,"If an issuer enters “Not Applicable” for all the relevant MOOPs, mark as \"Not Met.\" If an issuer enters “Not Applicable” for all family MOOPs, proceed to the next review. Otherwise, go to review 3."]
[2,null,"If family MOOP values are all “Not Applicable,” check the Business Rules Template to see whether the plan is intended to be offered to individuals only, not to families.",null,"Business Rules Template: Product ID, Plan ID (Standard Component), “What relationships between primary and dependent are allowed, and is the dependent required to live in the same household as the primary subscriber?”"]
[2,"a",null,"If the given Plan ID and Product ID do not exist in the Business Rules Template, use the default Issuer Rule (the row where both the Plan ID and the Product ID are blank)."]
[2,"b",null,"If the given Plan ID does not exist in the Business Rules Template, the given Product ID exists in the template, and the “What relationships between primary and dependent are allowed, and is the dependent required to live in the same household as the primary subscriber?” field is blank for the given Product ID, use the default Issuer Rule."]
[2,"c",null,"If the given Plan ID does not exist in the Business Rules Template, the given Product ID exists in the template, and the “What relationships between primary and dependent are allowed, and is the dependent required to live in the same household as the primary subscriber?” field is not blank for the given Product ID, use the Product Rule."]
[2,"d",null,"If the given Plan ID exists in the Business Rules Template and the “What relationships between primary and dependent are allowed, and is the dependent required to live in the same household as the primary subscriber?” field is not blank for the given Plan ID, use the Plan Rule."]
[2,"e",null,"If the given Plan ID and Product ID exist in the Business Rules Template and the “What relationships between primary and dependent are allowed, and is the dependent required to live in the same household as the primary subscriber?” field is blank for both the given Plan ID and Product ID, use the default Issuer Rule."]
[2,"f",null,"If the given Plan ID and Product ID exist in the Business Rules Template and the “What relationships between primary and dependent are allowed, and is the dependent required to live in the same household as the primary subscriber?” field is blank for the given Plan ID, but not blank for the Product ID, use the Product Rule."]
[2,"g",null,"For the relevant rule, if “What relationships between primary and dependent are allowed, and is the dependent required to live in the same household as the primary subscriber?” is equal to “Self, Yes” or “Self, No,” proceed to the next review to compare the individual MOOP. Otherwise, mark as \"Not Met\"."]
[3,null,"Compare the appropriate MOOP with the annual dollar limitation specified in regulation."]
[3,"a",null,"For QHPs, the threshold is determined in regulation and is finalized to be $9,450 for an individual and $18,900 for a family. Compare the Individual MOOP and Per Person Family MOOP to the individual limit and the Per Group Family MOOP to the family limit."]
[3,"b",null,"If the appropriate MOOP is at or below the threshold, the analysis is complete and the plan passes the MOOP cost-sharing review. If the appropriate MOOP is above the threshold, proceed to the next review."]
[4,null,"Check justifications."]
[4,"a",null,"If the MOOP is above the threshold and no justification is submitted, mark as \"Not Met.\""]
[4,"b",null,"If the MOOP is above the threshold and an appropriate justification is submitted, the plan has passed the MOOP review. Mark as \"Met.\""]
["Perform the Cost Sharing Reduction Plan Variation Review for all metal plans in the Individual Market."]
[1,null,"Determine whether all required plan variations have been created for the individual market plans."]
[1,"a",null,"For each silver plan, check for associated 73% AV, 87% AV, and 94% AV variations. If a silver plan variation is missing, mark as \"Not Met.\"","Market Coverage, HIOS Plan ID (Stand Component + Variant), Metal Level, CSR Variation Type"]
[1,"b",null,"For all metal level plans (except catastrophic), check for two variations: a zero cost-sharing plan variation and a limited cost-sharing plan variation. If a variation is missing, mark as \"Not Met.\"","Market Coverage, HIOS Plan ID (Stand Component + Variant), Metal Level, CSR Variation Type"]
[2,null,"Determine whether the appropriate MOOP is at or below the threshold."]
[2,"a",null,"For the 73% AV silver plan variation, the MOOP must be less than or equal to the finalized values of $7,550 for an individual or $15,100 for a family. Compare the Individual MOOP and Per Person Family MOOP to the individual limit and the Per Group Family MOOP to the family limit. If the appropriate MOOP exceeds the threshold, mark as \"Not Met.\"","CSR Variation Type, MOOP Fields"]
[2,"b",null,"For the 87% and 94% AV silver plan variations, the MOOP must be less than or equal to the finalized values of $3,150 for an individual or $6,300 for a family. Compare the Individual MOOP and Per Person Family MOOP to the individual limit and the Per Group Family MOOP to the family limit. If the appropriate MOOP exceeds the threshold, mark as \"Not Met.\"","CSR Variation Type, MOOP Field"]
[2,"c",null,"For the zero cost-sharing plan variation, all in-network EHB MOOP values must be $0. The out-of-network and combined in/out EHB MOOP values should be $0, but they also may be “Not Applicable” if the associated standard plan is “Not Applicable.” If any MOOP is not $0 (or “Not Applicable”), mark as \"Not Met.\"","CSR Variation Type, MOOP Fields"]
[2,"d",null,"For the limited cost-sharing plan variation, the MOOP must be the same as the associated standard plan’s MOOP. If any MOOP differs from the standard plan, mark as \"Not Met.\"","CSR Variation Type, MOOP Fields"]
[3,null,"Determine whether the cost sharing for benefits in the zero cost-sharing and limited cost-sharing plan variations are in accordance with HHS guidance.",null," "]
[3,"a",null,"For the zero cost-sharing plan variation, if EHB is “Yes” and the EHB Variance Reason is not “Not EHB,” or if EHB is blank and the EHB Variance Reason is “Additional EHB Benefit” or “Other Law/Regulation,” the benefit cost-sharing values must all be $0, 0%, or No Charge for both in and out of network. The out-of-network coinsurance may also be 100% if the standard plan is 100%. If any cost-sharing value is not 0 (or 100%), mark as \"Not Met.\"","EHB, CSR Variation Type, Default Copayment In Network, Default Coinsurance In Network, Copayment In Network (Tier 1), Copayment In Network (Tier 2), Copayment Out of Network, Coinsurance In Network (Tier 1), Coinsurance In Network (Tier 2), Coinsurance Out of Network"]
[3,"b",null,"For the zero cost-sharing plan variation, if EHB is blank and the EHB Variance Reason is not “Additional EHB Benefit” or “Other Law/Regulation,” or if EHB is “Yes” and EHB Variance Reason is “Not EHB,” the benefit cost sharing must follow successive cost sharing with the associated limited plan variation. If successive cost sharing is not followed, amark as \"Not Met.\"","EHB, EHB Variance Reason, HIOS Plan ID (Standard Component + Variant), CSR Variation Type, Default Copayment In Network, Default Coinsurance In Network, Copayment In Network (Tier 1), Copayment In Network (Tier 2), Copayment Out of Network, Coinsurance In Network (Tier 1), Coinsurance In Network (Tier 2), Coinsurance Out of Network"]
[3,"c",null,"For the zero cost-sharing plan variation, if EHB is blank and the EHB Variance Reason is not “Additional EHB Benefit” or “Other Law/Regulation,” or if EHB is “Yes” and EHB Variance Reason is “Not EHB” and Level of Coverage is “Silver,” the benefit cost sharing must follow successive cost sharing with the associated 94% AV plan variation. If successive cost sharing is not followed, mark as \"Not Met.\"","EHB, EHB Variance Reason, Level of Coverage, HIOS Plan ID (Standard Component + Variant), CSR Variation Type, Default Copayment In Network, Default Coinsurance In Network, Copayment In Network (Tier 1), Copayment In Network (Tier 2), Copayment Out of Network, Coinsurance In Network (Tier 1), Coinsurance In Network (Tier 2), Coinsurance Out of Network"]
[3,"d",null,"For the limited cost-sharing plan variation, if EHB is “Yes” and the EHB Variance Reason is not “Not EHB,” or if EHB is blank and the EHB Variance Reason is “Additional EHB Benefit” or “Other Law/Regulation,” benefit cost-sharing values must be the same as the associated standard plan’s value. If any cost-sharing values differ, mark as \"Not Met.\"","EHB, EHB Variance Reason, HIOS Plan ID (Standard Component + Variant CSR Variation Type, Default Copayment In Network, Default Coinsurance In Network, Copayment In Network (Tier 1), Copayment In Network (Tier 2), Copayment Out of Network, Coinsurance In Network (Tier 1), Coinsurance In Network (Tier 2), Coinsurance Out of Network"]
[3,"e",null,"For the limited cost-sharing plan variation, if EHB is “Yes” and the EHB Variance Reason is “Not EHB,” or if EHB is blank and the EHB Variance Reason is not “Additional EHB Benefit” or “Other Law/Regulation,” benefit cost-sharing values must follow successive cost sharing with the associated standard plan’s value. If successive cost sharing is not followed, mark as \"Not Met.\"","EHB, EHB Variance Reason, HIOS Plan ID (Standard Component + Variant CSR Variation Type, Default Copayment In Network, Default Coinsurance In Network, Copayment In Network (Tier 1), Copayment In Network (Tier 2), Copayment Out of Network, Coinsurance In Network (Tier 1), Coinsurance In Network (Tier 2), Coinsurance Out of Network"]
[4,null,"Determine whether the deductibles for the zero cost-sharing and limited cost-sharing plan variations are in accordance with HHS guidance.",null," "]
[4,"a",null,"For the zero cost-sharing plan variations, all in-network deductible values must be $0. The out-of-network and combined in/out deductible values should be $0, but they also may be “Not Applicable” if the associated standard plan is “Not Applicable.” If any deductible value is not $0 (or “Not Applicable”), mark as \"Not Met.\"","CSR Variation Type, HIOS Plan ID (Stand Component + Variant), Medical Deductible (all values), Drug EHB Deductible (all values), Combined Medical and Drug Deductible (all values)"]
[4,"b",null,"For the limited cost-sharing plan variation, all deductible values must be the same as the associated standard plan’s value. If deductible values differ, mark as \"Not Met.\"","CSR Variation Type, HIOS Plan ID (Stand Component + Variant), Medical Deductible (all values), Drug EHB Deductible (all values), Combined Medical and Drug Deductible (all values)"]
[5,null,"Determine whether plan variations have the required tier utilization."]
[5,"a",null,"All plan variations (73%, 87%, and 94% AV silver plan variations and zero cost-sharing and limited cost-sharing plan variations) must have the same first and second tier utilization as the associated standard plan. If either the first or second tier utilization differs, mark as \"Not Met.\"","HIOS Plan ID (Standard Component + Variant), Metal Level, CSR Variation Type, 1st Tier Utilization, 2nd Tier Utilization"]
[6,null,"Determine whether the AVs for all plan variations are in accordance with HHS guidance."]
[6,"a",null,"If the plan has a unique design, the issuer AV is evaluated. If the plan does not have a unique plan design, the AV calculator output number is evaluated.","Unique Plan Design? HIOS Plan ID (Standard Component), HIOS Plan ID (Standard Component and Variant)"]
[6,"b",null,"The 73% AV silver plan variation’s AV must be between 73% and 74%. If the AV is outside the allowed range, mark as \"Not Met.\"","Unique Plan Design? HIOS Plan ID (Standard Component), HIOS Plan ID (Standard Component and Variant), Metal Level, CSR Variation Type, AV calculator output number"]
[6,"c",null,"The 73% AV silver plan variation’s AV must be at least 2 percentage points different from the associated standard silver plan’s actual AV. If the AV is within 2 percentage points of the associated standard silver plan, mark as \"Not Met.\"","Unique Plan Design? HIOS Plan ID (Standard Component), HIOS Plan ID (Standard Component and Variant), HIOS Plan ID (Standard Component + Variant), CSR Variation Type, Metal Level, AV calculator output number"]
[6,"d",null,"The 87% AV silver plan variation’s AV must be between 87% and 88%. If the AV is outside the allowed range, mark as \"Not Met.\"","Unique Plan Design? HIOS Plan ID (Standard Component), HIOS Plan ID (Standard Component and Variant), Metal Level, CSR Variation Type, AV calculator output number"]
[6,"e",null,"The 94% AV silver plan variation’s AV must be between 94% and 95%. If the AV is outside the allowed range, mark as \"Not Met.\"","Unique Plan Design? HIOS Plan ID (Standard Component), HIOS Plan ID (Standard Component and Variant), Metal Level, AV calculator output number"]
[6,"f",null,"The zero cost-sharing plan variation’s AV must be 100%. If the AV is not 100%, mark as \"Not Met.\"","Unique Plan Design? HIOS Plan ID (Standard Component), HIOS Plan ID (Standard Component and Variant), CSR Variation Type, AV calculator output number"]
[6,"g",null,"The limited cost-sharing plan variation’s AV must be greater than or equal to the associated standard plan’s AV. If the AV is not greater than or equal to the associated standard plan, mark as \"Not Met.\"","Unique Plan Design? HIOS Plan ID (Standard Component), HIOS Plan ID (Standard Component and Variant), HIOS Plan ID (Standard Component + Variant), CSR Variation Type, AV calculator output number"]
[7,null,"Determine whether for related silver plan variations, successive cost sharing is followed, meaning benefit cost sharing decreases or stays the same as the AVs increase."]
[7,"a",null,"The EHB MOOP values for the 94% AV variation must be less than or equal to the EHB MOOP values for the 87% AV variation, which must be less than or equal to the EHB MOOP values for the 73% AV variation, which must be less than or equal to the standard silver plan. If the AV variations and appropriate EHB MOOPs do not adhere to the relationship described above, mark as \"Not Met.\"","HIOS Plan ID (Standard Component + Variant), Metal Level, CSR Variation Type, MOOPs"]
[7,"b",null,"The EHB deductible values for the 94% AV variation must be less than or equal to the EHB deductible values for the 87% AV variation, which must be less than or equal to the EHB deductible values for the 73% AV variation, which must be less than or equal to the EHB deductible values for the standard silver plan. If the AV variations and appropriate EHB deductible do not adhere to the relationship described above, mark as \"Not Met.\"","HIOS Plan ID (Standard Component + Variant), Metal Level CSR Variation Type"]
[7,"c",null,"The copay and coinsurance values for all benefits for the 94% AV variation must be less than or equal to the values for the 87% AV variation, which must be less than or equal to the values for the 73% AV variation, which must be less than or equal to the values for the standard silver plan. If the AV variations and copayment and coinsurance values for covered benefits do not adhere to the relationship described above, mark as \"Not Met.\"","HIOS Plan ID (Standard Component), Is this Benefit Covered? HIOS Plan ID (Standard Component + Variant), CSR Variation Type, Reference, Copayment In Network (Tier 1), Copayment In Network (Tier 2), Copayment Out of Network, Coinsurance In Network (Tier 1), Coinsurance In Network (Tier 2), Coinsurance Out of Network"]
["Perform the Catastrophic Plan Review for all plans with a metal level of Catastrophic"]
[1,null,"Confirm that the catastrophic plan is offered only in the individual market."]
[1,"a",null,"If the Market Coverage is “SHOP (Small Group),” mark as \"Not Met.\"","Market Coverage"]
[2,null,"Ensure that the catastrophic plan does not have multiple in-network tiers."]
[2,"a",null,"If Multiple In Network Tiers? is “Yes,” mark as \"Not Met.\"","Multiple In Network Tiers?"]
[3,null,"Ensure that medical and drug deductibles and MOOPs are integrated."]
[3,"a",null,"If Medical & Drug Maximum Out of Pocket Integrated? is “No,” mark as \"Not Met.\"","Medical & Drug Maximum Out of Pocket Integrated?"]
[3,"b",null,"If Medical & Drug Deductibles Integrated? is “No,” mark as \"Not Met.\"","Medical & Drug Deductibles Integrated?"]
[4,null,"Check the in-network copay and coinsurance values."]
[4,"a",null,"Perform this check for each benefit, excluding “Primary Care to Treat Illness or Injury,” if EHB is “Yes” and EHB Variance Reason is not “Above EHB,” or if EHB is blank and EHB Variance Reason is “Additional EHB Benefit” or “Other Law/Regulation.”","EHB, EHB Variance Reason, In Network (Tier 1) Copay, In Network (Tier 1) Coinsurance"]
[null,null,null,"All In Network (Tier 1) Copay and In Network (Tier 1) Coinsurance values must be equal to “$0,” “0%,” “No Charge,” “$0 after deductible,” “0% after deductible,” “No Charge after deductible,” “$0 per day,” or “$0 per stay.” If the values of In Network (Tier 1) Copay or In Network (Tier 1) Coinsurance do not equal any of those, mark as \"Not Met.\""]
[null,null,null,"The combination of copay and coinsurance data entry for the benefit must indicate that the consumer does not have any out-of-pocket charges after meeting the deductible. This data entry would result in “No Charge After Deductible” being displayed for In Network on Plan Compare."]
[5,null,"Check that cost sharing is subject to deductible."]
[5,"a",null,"For each benefit, excluding “Primary Care to Treat Illness or Injury” and “Preventive care/screening/ immunization,” if EHB = “Yes” and EHB Variance Reason is not \"Not EHB,” or if EHB Variance Reason is “Additional EHB Benefit” or “Other Law/Regulation,” In Network (Tier 1) Copay or In Network (Tier 1) Coinsurance cost sharing must include “after deductible.” If not, mark as \"Not Met.\"","EHB, Is This Benefit Covered? EHB Variance Reason, In Network (Tier 1) Copay, In Network (Tier 1) Coinsurance"]
[5,"b",null,"If the benefit is “Preventive care/screening/immunization,” In Network (Tier 1) Copay and In Network (Tier 1) Coinsurance must be equal to “$0,” “0%,” or “No Charge.” If it is equal to any other value, mark as \"Not Met.\"","EHB Variance Reason, In Network (Tier 1) Copay, In Network (Tier 1) Coinsurance"]
[6,null,"Check MOOPs and deductibles against the annual limitations on cost sharing."]
[6,"a",null,"If Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) In Network Individual is not equal to the annual dollar limitation specified by the 2024 Payment Notice or “Not Applicable,” mark as \"Not Met.\"","Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) In Network Individual"]
[6,"b",null,"If Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) In Network Individual is “Not Applicable,” Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) Combined In/Out of Network Individual must be equal to the annual dollar limitation specified by the 2024 Payment Notice. If it is not, mark as \"Not Met.\"","Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) In Network Individual, Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) Combined In/Out of Network Individual"]
[6,"c",null,"If Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) In Network Individual has a value other than “Not Applicable,” Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) Combined In/Out of Network Individual must be equal to or greater than the value specified by the 2024 Payment Notice. If it is not, mark as \"Not Met.\"","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) In Network Individual, Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) Combined In/Out of Network Individual"]
[6,"d",null,"If Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) Out of Network Individual is not equal to or greater than the annual dollar limitation specified by the 2024 Payment Notice, mark as \"Not Met.\"","Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) Out of Network Individual"]
[6,"e",null,"If Combined Medical & Drug EHB Deductible In Network Individual is not equal to the annual dollar limitation specified by the 2024 Payment Notice or “Not Applicable,” mark as \"Not Met.\"","Combined Medical & Drug EHB Deductible In Network Individual"]
[6,"f",null,"If Combined Medical & Drug EHB Deductible In Network Individual is “Not Applicable,” Combined Medical & Drug EHB Deductible Combined In/Out of Network Individual must be equal to the annual dollar limitation specified by the 2024 Payment Notice. If it is not, mark as \"Not Met.\"","Combined Medical & Drug EHB Deductible In Network Individual, Combined Medical & Drug EHB Deductible Combined In/Out of Network Individual"]
[6,"g",null,"If Combined Medical & Drug EHB Deductible In Network Individual has a value other than “Not Applicable,” Maximum Out of Pocket for Medical & Drug EHB Benefits (Total) Combined In/Out of Network Individual must be equal to or greater than the annual dollar limitation specified by the 2024 Payment Notice. If it is not, mark as \"Not Met.\"","Combined Medical & Drug EHB Deductible In Network Individual, Combined Medical & Drug EHB Deductible Combined In/Out of Network Individual"]
[6,"h",null,"If Combined Medical & Drug EHB Deductible Out of Network Individual is not equal to or greater than the annual dollar limitation specified by the 2024 Payment Notice, mark as \"Not Met.\"","Combined Medical & Drug EHB Deductible Out of Network Individual"]
["Perform the Standardized Options Review for all plans."]
[1,null,"Ensure that only Bronze, Silver, Gold and Platinum plans indicate they are an standardized option."]
[1,"a",null,"If the plan is a SHOP (Small Group) plan and Design Type is not equal to “Not Applicable,” mark as \"Not Met\" and complete the review.","Market Coverage, Design Type"]
[1,"b",null,"If the plan is an Individual Market plan and Level of Coverage is “Low,” “High,”or “Catastrophic,” and Design Type is not equal to “Not Applicable,” mark as \"Not Met\" and complete the review.","Level of Coverage, Design Type, Market Coverage"]
[1,"c",null,"If the Level of Coverage is “Bronze,” “Silver,” “Gold,” or \"Platinum\" and Design Type is equal to “Not Applicable,” complete review; otherwise proceed to review step 2.","Level of Coverage"]
[null,null,null,null,"Design Type"]
[2,null,"Determine the appropriate value for the metal level to ensure plans indicating they are standardized options have the correct Plan Cost Sharing Attributes values."]
[2,"a",null,"Compare the value for Medical & Drug Deductibles Integrated? with the value for the plan. If different, mark as \"Not Met.\"","Medical & Drug Deductibles Integrated?"]
[null,null,null,null,"CSR Variation Type"]
[2,"b",null,"Compare the value for Medical & Drug Maximum Out of Pocket Integrated? with the value for the plan. If different, mark as \"Not Met.\"","Medical & Drug Maximum Out of Pocket Integrated?"]
[null,null,null,null,"CSR Variation Type"]
[2,"c",null,"Compare the value for Multiple In Network Tiers? with the value for the plan. If different, mark as \"Not Met.\"","Medical & Drug Maximum Out of Pocket Integrated?"]
[null,null,null,null,"CSR Variation Type"]
[3,null,"Determine the appropriate value for the metal level to ensure plans indicating they are standardized options have the correct MOOP values."]
[3,"a",null,"Compare the value for Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) - In Network - Individual with the value for the plan. If different, mark as \"Not Met.\"","MOOP"]
[null,null,null,null,"CSR Variation Type"]
[3,"b",null,"Compare the value for Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) - In Network - Family with the value for the plan. If different, mark as \"Not Met.\"","MOOP"]
[null,null,null,null,"CSR Variation Type"]
[4,null,"Determine the appropriate value for the metal level to ensure plans indicating they are standardized options have the correct deductible values."]
[4,"a",null,"Compare the value for Combined Medical and Drug EHB Deductible - In Network - Individual with the value for the plan. If different, mark as \"Not Met.\"","Deductible"]
[null,null,null,null,"CSR Variation Type"]
[4,"b",null,"Compare the value for Combined Medical and Drug EHB Deductible - In Network - Family with the value for the plan. If different, mark as \"Not Met.\"","Deductible"]
[null,null,null,null,"CSR Variation Type"]
[4,"c",null,"Compare the value for Combined Medical and Drug EHB Deductible - In Network – Default Coinsurance with the value for the plan. If different, mark as \"Not Met.\"","Deductible"]
[null,null,null,null,"CSR Variation Type"]
[5,null,"Determine the appropriate value for the metal level to ensure plans indicating they are standardized options have the correct copay and coinsurance values."]
[5,"a",null,"For each benefit, compare the value for Copay – In Network (Tier 1) with the value for the plan. If different, mark as \"Not Met.\"","Copay"]
[null,null,null,null,"CSR Variation Type"]
[5,"b",null,"For each benefit, compare the value for Coinsurance – In Network (Tier 1) with the value for the plan. If different, mark as \"Not Met.\"","Coinsurance"]
[null,null,null,null,"CSR Variation Type"]

{"sheet":"Non-Discrimination Cost Sharing","index":9,"n_rows":91,"n_cols":6,"rows_kept":91,"cut":false,"hidden":false,"merged":[[25,0,26,0],[36,0,38,0],[36,1,38,1],[36,2,38,2],[36,4,38,4],[29,0,30,0],[29,1,30,1],[29,4,30,4],[25,1,26,1],[25,2,26,2],[25,4,26,4],[27,0,28,0],[27,1,28,1],[27,2,28,2],[27,4,28,4],[31,4,32,4],[0,0,0,4],[10,0,18,0],[10,1,18,1],[10,2,18,2],[10,4,18,4],[8,0,8,4],[21,0,21,4],[23,0,24,0],[23,1,24,1],[23,2,24,2],[23,4,24,4],[31,1,32,1],[31,0,32,0],[39,0,42,0],[39,1,42,1],[39,2,42,2],[39,4,42,4],[49,0,50,0],[49,1,50,1],[49,2,50,2],[49,4,50,4],[51,0,54,0],[51,1,54,1],[51,2,54,2],[51,4,54,4],[66,0,67,0],[66,1,67,1],[66,2,67,2],[66,4,67,4],[68,4,69,4],[76,4,78,4],[79,0,80,0],[79,1,80,1],[79,2,80,2],[79,4,80,4],[76,0,78,0],[76,1,78,1],[76,2,78,2],[68,0,69,0],[68,1,69,1],[68,2,69,2]]}
["Discriminatory Cost Sharing Review Process Steps"]
[]
["There is a stand-alone tool available to assist in the non-discrimination review. The following explains the steps followed in the tool."]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"Plan ID:"]
[null,null,null,null,"SELECT REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
["Perform the EHB Non-Discrimination Language Review Business Rules for all plans."]
[1,null,"Review Exclusions and Explanation (text field) for discriminatory language.",null,"Non-Discrimination Guidance"]
[1,"a",null,"Review that the Exclusions and Explanation fields do not contain limit information that contradicts information entered in the corresponding limit data elements:","Benefits 1-13: Exclusions, Explanation (text field), Limit Quantity, Limit Unit"]
[null,null,null,"¿ Limit Quantity"]
[null,null,null,"¿ Limit Unit."]
[null,null,null,"Also, review text for the following:"]
[null,null,null,"¿ Discriminatory language related to limits or exclusions"]
[null,null,null,"¿ Obvious policy violations"]
[null,null,null,"¿ Unlawful exclusions or limits."]
[null,null,null,"Pay special attention to the terms listed for EHB text review (see “Text Review Approach”). The list is not exhaustive; if any text in an Exclusions or Explanation field has one or more of the above characteristics, it may be discriminatory."]
[null,null,null,"EHB text review should focus on language related to limits or other restrictions to covered benefits. QHP text review should focus on language related to cost sharing."]
[1,"b",null,"If any discriminatory language was identified, check whether justification was submitted. "]
[1,"c",null,"If justification was not submitted or is insufficient based on policy criteria, mark as \"Not Met.\""]
["Perform the QHP Cost-Sharing and Language Non-Discrimination Review Business Rules for all plans."]
[1,null,"Determine whether the cost-sharing structure for each benefit for each plan is copayment, coinsurance, or both."]
[1,"a",null,"If benefit being checked uses a copay per day/stay (Inpatient Hospital Services, Mental/Behavioral Health Inpatient Services, and Substance Abuse Disorder Inpatient Services) use step 1b, otherwise use this step.\nCheck whether the plan has a copayment. The plan is considered to have a copayment if the copayment field contains any value not equal to “Not Applicable” and the coinsurance is 0. The specific fields to use for evaluation are below:\n","Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[null,null,null,"¿  If Copay In Network (Tier 1) is not empty and not equal to “Not Applicable” and Coinsurance In Network (Tier 1) is one of the following—empty, “No Charge,” “No Charge after deductible,” 0% “Coinsurance after deductible,” “Not Applicable,” or 0%—the plan is treated as having a copay. Treat “No Charge” and “No Charge after deductible” as $0 and include in the copay analysis. For all other entries, just extract the numeric value and treat them the same, regardless of wording. "]
[1,"b",null,"If benefit being checked does not use a copay per day/stay use step 1a, otherwise use this step.\nCheck whether the plan has a copayment. The plan is considered to have a copayment if the copayment field contains any value not equal to “Not Applicable” and the coinsurance is 0. The specific fields to use for evaluation are below:\n","Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[null,null,null,"¿  If Copay In Network (Tier 1) is not empty and not equal to “Not Applicable” and Coinsurance In Network (Tier 1) is one of the following—empty, “No Charge,” “No Charge after deductible,” 0% “Coinsurance after deductible,” “Not Applicable,” or 0%—the plan is treated as having a copay. Treat “No Charge” and “No Charge after deductible” as $0. This amount should be included in both the copay per day and copay per stay outlier threshold calculations; the plan itself should be evaluated against the per stay threshold. \n\nFor all other entries, extract the numeric value and treat them as either copay per day or copay per stay, depending on the text included in the field. If the copay text does not distinguish between per day or per stay —“Copay before deductible,” “Copay after deductible,” or “$X” —treat the plan as copay per stay."]
[1,"c",null,"Check whether the plan has coinsurance. The plan is considered as having coinsurance if the coinsurance field contains any value not equal to “Not Applicable” and copayment is equivalent to 0. Use the following fields:","Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[null,null,null,"¿ If Coinsurance In Network (Tier 1) is not empty and not equal to “Not Applicable” and Copay In Network (Tier 1) is one of the following—empty, “No Charge,” “No Charge after deductible,” $0, $0 “Copay after deductible,” “Not Applicable,” $0 “Copay before deductible,” “$0 Copay per Stay,” “$0 Copay per Stay after deductible,” “$0 Copay per Stay before deductible,” “$0 Copay per Day,” “$0 Copay per Day after deductible,” “$0 Copay per Day before deductible,”—the plan is treated as having coinsurance. Treat “No Charge” and “No Charge after deductible” as 0% and include it in the coinsurance analysis. For all other entries, extract the numeric value and treat them the same, regardless of wording. "]
[1,"d",null,"If benefit being checked uses a copay per day/stay (Inpatient Hospital Services, Mental/Behavioral Health Inpatient Services, and Substance Abuse Disorder Inpatient Services) use step 1e, otherwise use this step.\nUse this step if both copayment and coinsurance have a value not equivalent to 0 or “Not Applicable.” Use the following fields:\n","Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[null,null,null,"¿ If Copay In Network (Tier 1) has a value greater than 0 and not equal to “Not Applicable” for “Copay after deductible,” “Copay before deductible,” or “$X” and Coinsurance In Network (Tier 1) has a value greater than 0 and not equal to “Not Applicable” for “Coinsurance after deductible,” “Coinsurance before deductible,” or “X%,” assign the values to each copay and coinsurance and use the value in the corresponding analysis."]
[1,"e",null,"If benefit being checked does not use a copay per day/stay use step 1d, otherwise use this step.\nUse this step if both copayment and coinsurance have a value not equivalent to 0 or “Not Applicable.” Use the following fields:\n","Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[null,null,null,"¿ If Copay In Network (Tier 1) has a value greater than 0 and not equal to “Not Applicable” for “Copay after deductible,” “Copay before deductible,” “$X,” “Copay per Stay,” “Copay per Stay after deductible,” “Copay per Stay before deductible,” “Copay per Day,” “Copay per Day after deductible,” or “Copay per Day before deductible,” and Coinsurance In Network (Tier 1) has a value greater than 0 and not equal to “Not Applicable” for “Coinsurance after deductible,” “Coinsurance before deductible,” or “X%,” assign the values to each copay and coinsurance and use the value in the corresponding analysis.\n\nIf the copay text does not distinguish between per day or per stay —“Copay before deductible,” “Copay after deductible,” or “$X” —treat the plan as copay per stay.\n"]
[2,null,"Group plans by metal level."]
[2,"a",null,"Group plans by metal level for both the state and the national analyses. Only plans in the same metal level are compared for all cost-sharing review steps that follow.","Metal Level"]
[3,null,"If outlier thresholds need to be calculated and all initial submissions have been received for each benefit, group all plans with the same metal level that were determined to have a copay for that benefit and calculate the outlier thresholds at the national level. If outlier thresholds have already been calculated, proceed to the next review."]
[3,"a",null,"Analyze outliers for copay using the modified Tukey’s Test method, with","Copay In Network (Tier 1)"]
[null,null,null,"M = 1.5 for each cluster of plans with"]
[null,null,null,"N > = 5. If N < 5, return “No Result” for plans in that group."]
[3,"b",null,"Store the upper threshold for each benefit field/metal level combination that has"]
[null,null,null,"N > = 5."]
[null,null,null,"Inpatient Hospital Services, Mental/Behavioral Health Inpatient Services, and Substance Abuse Disorder Inpatient Services have to be handled differently from the other benefits."]
[null,null,null,"These three benefits have two separate copay outlier thresholds, one for “Copay per Stay” and one for “Copay per Day.” These two categories are too different to be compared with each other, so two separate thresholds are needed. Every other benefit needs only one copay threshold because all of the copays are similar and do not have the different designations of per day and per stay."]
[3,"c",null,"If any lower-value metal level has a threshold that is more stringent (lower) than a higher-value metal level for the same benefit, adjust the lower-value metal level’s threshold to be equal to the higher-value metal level’s threshold."]
[3,"d",null,"If any threshold is equal to 0, change to “No Result.”"]
[4,null,"Determine whether copay is an outlier at the national level for each benefit."]
[4,"a",null,"Compare Copay In Network (Tier 1) with the appropriate upper threshold stored from the initial outlier calculation.","Copay In Network (Tier 1)"]
[4,"b",null,"Flag all plans that have high outliers (above the upper threshold). If the threshold is “No Result,” the plan should receive “Not Applicable” because it cannot be tested."]
[5,null,"If outlier thresholds need to be calculated and all initial submissions have been received for each benefit, group all plans with the same metal level that were determined to have a copay for that benefit and calculate the outlier thresholds at the state level. If outlier thresholds have already been calculated, proceed to the next review."]
[5,"a",null,"Analyze outliers for copay by using the modified Tukey’s Test method with M = 1.5 for each cluster of plans with N > = 5. If","Copay In Network (Tier 1)"]
[null,null,null,"N < 5, return “No Result” for plans in that group."]
[5,"b",null,"Store the upper threshold for each benefit field/metal level combination that has"]
[null,null,null,"N > = 5."]
[null,null,null,"Inpatient Hospital Services, Mental/Behavioral Health Inpatient Services, and Substance Abuse Disorder Inpatient Services have to be handled differently from the other benefits. "]
[null,null,null,"These three benefits have two separate copay outlier thresholds, one for “Copay per Stay” and one for “Copay per Day.” These two categories are too different to be compared with each other, so two separate thresholds are needed. Every other benefit needs only one copay threshold because all of the copays are similar and do not have the different designations of per day and per stay."]
[5,"c",null,"If any lower-value metal level has a threshold that is more stringent (lower) than a higher-value metal level for the same benefit, adjust the lower-value metal level’s threshold to be equal to the higher-value metal level’s threshold.","Copay In Network (Tier 1)"]
[5,"d",null,"If any threshold is equal to 0, change to “No Result.”"]
[6,null,"Determine whether copay is an outlier at the state level for each benefit."]
[6,"a",null,"Compare Copay In Network (Tier 1) with the appropriate upper threshold stored from the initial outlier calculation.","Benefits 1–15: Copay In Network (Tier 1)"]
[6,"b",null,"Flag all plans that have high outliers (above the upper threshold). If the threshold is “No Result,” the plan should receive “Not Applicable” because it cannot be tested."]
[7,null,"Determine whether each plan is an outlier for the copay."]
[7,"a",null,"If a plan received a flag for a benefit copay at both the state and national levels, check whether the corresponding benefit is subject to the deductible."]
[7,"b",null,"A benefit is subject to the deductible if its copay and/or coinsurance fields contain the word “deductible.” For instance, if a plan’s Generic Drug copay is equal to “$10 before deductible,” then the Generic Drug benefit is subject to the deductible for that plan.","Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[7,"c",null,"If a benefit is not subject to the deductible (i.e., neither the copay nor coinsurance fields contain the word “deductible”), then the plan can be twice the corresponding outlier thresholds before it is marked as \"Not Met.\" If the benefit is still an outlier, check whether justification was submitted.","Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[7,"d",null,"If justification was not submitted or is insufficient based on policy criteria, the plan is marked as being an outlier for that benefit cost sharing. Plans that received a flag as outliers at both the state and national levels and that have no or insufficient justification are marked as \"Not Met.\""]
[8,null,"If outlier thresholds need to be calculated and all initial submissions have been received for each benefit, group all plans with the same metal level that were determined to have a coinsurance for that benefit and calculate the outlier thresholds at the national level. If outlier thresholds have already been calculated, proceed to the next review."]
[8,"a",null,"Analyze outliers for coinsurance using the modified Tukey’s Test method with M = 1.5 for each cluster of plans with N > = 5. If","Coinsurance In Network (Tier 1)"]
[null,null,null,"N < 5, return “No Result” for plans in that group."]
[8,"b",null,"Store the upper threshold for each benefit field/metal level combination that has"]
[null,null,null,"N > = 5."]
[8,"c",null,"If any lower-value metal level has a threshold that is more stringent (lower) than a higher-value metal level for the same benefit, adjust the lower-value metal level’s threshold to be equal to the higher-value metal level’s threshold."]
[8,"d",null,"If any threshold is equal to 0, change to “No Result.”"]
[9,null,"Determine whether each plan’s coinsurance is an outlier at the national level for each benefit."]
[9,"a",null,"Compare Coinsurance In Network (Tier 1) with the appropriate upper threshold stored from the initial outlier calculation.","Coinsurance In Network (Tier 1)"]
[9,"b",null,"Flag all plans that have high outliers (above the upper threshold). If the threshold is “No Result,” the plan should receive “Not Applicable” because it cannot be tested."]
[10,null,"If the outlier thresholds need to be calculated and all initial submissions have been received for each benefit, group all plans with the same metal level that were determined to have a coinsurance for that benefit and calculate the outlier thresholds at the state level. If outlier thresholds have already been calculated, proceed to the next review."]
[10,"a",null,"Analyze outliers for coinsurance by using the modified Tukey’s Test method with","Coinsurance In Network (Tier 1)"]
[null,null,null,"M = 1.5 for each cluster of plans with"]
[null,null,null,"N > = 5. If N < 5, return “No Result” for plans in that group."]
[10,"b",null,"Store the upper threshold for each benefit field/metal level combination that has"]
[null,null,null,"N > = 5."]
[10,"c",null,"If any lower-value metal level has a threshold that is more stringent (lower) than a higher-value metal level for the same benefit, adjust the lower-value metal level’s threshold to be equal to the higher-value metal level’s threshold."]
[10,"d",null,"If any threshold is equal to 0, change to “No Result.”"]
[11,null,"Determine whether coinsurance is an outlier at the state level for each benefit."]
[11,"a",null,"Compare Coinsurance In Network (Tier 1) with the appropriate upper threshold stored from the initial outlier calculation.","Copay In Network (Tier 1)"]
[11,"b",null,"Flag all plans that have high outliers (above the upper threshold). If the threshold is “No Result,” the plan should receive “Not Applicable” because it cannot be tested."]
[12,null,"Determine whether each plan is an outlier for coinsurance."]
[12,"a",null,"If a plan received a flag for a benefit coinsurance at the state and national levels, check whether the corresponding benefit is subject to the deductible."]
[12,"b",null,"A benefit is subject to the deductible if its copay and/or coinsurance fields contain the word “deductible.” For instance, if a plan’s generic drug copay is equal to “$10 before deductible,” then the generic drug benefit is subject to the deductible for that plan.","Benefits 1–15: Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[12,"c",null,"If a benefit is not subject to the deductible (i.e., neither the copay nor coinsurance fields contain the word “deductible”), then the coinsurance amount can be up to 90% before it is considered an outlier. If the benefit has still not passed the evaluation, check whether a justification was submitted.","Benefits 1–15: Copay In Network (Tier 1), Coinsurance In Network (Tier 1)"]
[12,"d",null,"If a justification was not submitted or is insufficient based on policy criteria, the plan is an outlier for that benefit cost sharing. Plans that received a flag at the state and national levels and have no justification or insufficient justification are \"Not Met.\""]

{"sheet":"Service Area","index":10,"n_rows":16,"n_cols":6,"rows_kept":16,"cut":false,"hidden":false,"merged":[[0,0,0,4]]}
["Service Area Review Process Steps"]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"Service Area ID:"]
[null,null,null,null,"SELECT REVIEW RESULT:  "]
["Review","Review step","Review description and procedure","Step description","Source"]
[1,null,"Determine whether the Service Area ID is unique.",null,"Service Area Template"]
[1,"a",null,"Determine whether more than one row of service area information is provided. If no, go to review 2. If yes, go to the next step."]
[1,"b",null,"Determine whether the same Service Area ID is used for a service area that covers the entire state (“yes” response in column C) and for a service area that covers part of the state (“no” response in column C). If no, go to the next review. If yes, mark as \"Not Met,\" add comments where applicable, and go to the next review."]
[2,null,"Determine whether the Service Area ID is unique for medical and dental plans (dual issuers only).",null,"Service Area Template"]
[2,"a",null,"Determine whether the same Service Area ID is used for both a medical plan and a dental plan. If no, go to review 3. If yes, mark as \"Not Met,\" add comments where applicable, and go to the next review."]
[3,null,"Determine whether the service area includes a full or partial county.",null,"Service Area Template"]
[3,"a",null,"Check the Partial County column (E) in the Service Area Template. If “yes,” go to the next review. If “no,” add a general comment “no partial county,” finalize the section, and end the service area review."]
[4,null,"Determine whether the required partial county documents are uploaded.",null,"Service Area Supplemental Response and Evidence of State Approval"]
[4,"a",null,"Check whether the issuer uploaded the partial county supplemental response. If yes, proceed to the next step. If no, mark as \"Not Met,\" add comments where applicable, and go to the next step."]
[4,"b",null,"Check whether the issuer uploaded evidence of state approval. If yes, proceed to the next review. If no, mark as \"Not Met,\" add comments where applicable, and go to the next review."]

{"sheet":"QIS","index":11,"n_rows":255,"n_cols":25,"rows_kept":255,"cut":false,"hidden":false,"merged":[]}
["Quality Improvement Strategy (QIS) 2024 Implementation Plan Form, Progress Report Form, and Modification Summary Supplement Form Review Steps"]
["This is a tool for States performing plan management to assess whether issuers' QIS Implementation Plan, Progress Report, and Modification Summary Supplement forms meet the fundamental QIS requirements as specified in Section 1311(g) of the Affordable Care Act, and as explained in the QIS Technical Guidance and User Guide for the 2024 Plan Year. "]
["As you review each Element, use the drop-down menus to note whether each issuer meets, does not meet, or meets the requirement in the interim. For a description of each of these results, please see the QIS Technical Guidance and User Guide for the 2024 Plan Year. "]
["If an issuer does not meet a requirement, or meets the requirement in the interim use the drop-down menu under \"Deficiency Language\" to select the appropriate deficiency. "]
[null,null,null,null,null,"Validation Results"]
[null,null,null,null,"HIOS Issuer ID:"]
[null,null,null,null,"QIS Form #: "]
[null,null,null,null,"SELECT REVIEW RESULT:"]
["Review Element/ Criterion","Review Step","Review Description and Procedure","Step Description","Refer to Source","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language","Does Issuer Meet the Requirement? Yes/No/NA","Deficiency Language"]
["Implementation Plan Form"]
["New QIS Submission (Part A), Issuer Information (Part B)"]
["Element 1 \n(Required, Not Scored)",null,"Confirm that Element 1: Type of QIS Submission is complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 1","a",null,"Issuer selected one QIS submission type"]
["Element 2 \n(Required, Not Scored)",null,"Confirm that Element 2: Targets All QHPs and Product Types Offered Through an Exchange is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Criterion 2a","a",null,"Criterion 2a: Issuer indicated if this QIS is applicable to all its eligible QHPs or to a subset of its eligible QHPs."]
["Criterion 2b","b",null,"Criterion 2b: Issuer selected at least one relevant product type (e.g., HMO, PPO) to which the QIS applies."]
["Elements 3 - 15\n(Required, Not Scored)",null,"Confirm that Elements 3 - 15 within Part B: Issuer Information are complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Elements 3 - 15","a",null,"Issuer provided identifying information in each response field."]
["Element 16\n(Required, Not Scored)",null,"Confirm that Element 16: Current Payment Model(s) Description is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 16","a",null,"Issuer selected one or more category(ies) of payment models that are used by the issuer across its Exchange product line."]
["Element 16","b",null,"If \"Fee for Service - No Link to Quality and Value\" was checked, issuer provided the percentage of payments not tied to quality and value."]
["Element 16","c",null,"If \"Fee for Service - Linked to Quality and Value\" was checked, issuer provided the percentage of payments tied to quality and value."]
["Element 16","d",null,"If \"Alternative Payment Models Build on Fee for Service Architecture\" was checked, issuer provided the percentage of payments tied to quality and value."]
["Element 16","e",null,"If \"Population-based Payment\" was checked, issuer provided the percentage of payments tied to quality and value."]
["Element 16","f",null,"Issuer confirmed the total percentage of payments across all four payment model types equals approximately 100 percent. "]
["Elements 1-16",null,"Determine whether Issuer met the requirements in Elements 1-16: Review the issuer's evaluation results in Column F for Part A: New, Discontinuing, or Continuing QIS Submission and Part B: Issuer Information (Elements 1-16).",null,"See Review Tool"]
["Elements 1-16","a",null,"The elements in rows 12-25 are required, but not scored. If the issuer received a “No” result for any of the steps in those rows, the State may designate a review result of “Does Not Meet” and ask issuers to correct and resubmit information that is missing or was left blank. Continue to the next review step to identify other possible deficiencies."]
["Data Sources Used for Goal Identification and Monitoring Progress (Part C), QIS Implementation Plan Section (Parts D and E)"]
["Element 17\n(Required, Not Scored)",null,"Confirm that Element 17: Data Sources is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 17","a",null,"Issuer indicated one or more data sources used to identify QHP enrollee population needs and support the QIS rationale, or checked \"Other.\""]
["Element 17","b",null,"If \"Census data\" was checked, issuer provided the specific type of census data (e.g., block, tract, ZIP Code) in the box."]
["Element 17","c",null,"If \"Other\" was checked, issuer provided a description of the other data sources in the space provided."]
["Element 18\n(Required, Not Scored)",null,"Confirm that Element 18: QIS Title is complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 18","a",null,"Issuer provided a title for the QIS."]
["Element 19\n(Required, Not Scored)",null,"Confirm that Element 19: QIS Description is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Criterion 19a","a",null,"Issuer provided a summary description of the QIS that includes the market-based incentive(s) and topic area(s) of the QIS."]
["Criterion 19b","b",null,"Issuer checked whether the QIS described in Element 19 is part of a mandatory State initiative."]
["Criterion 19c","c",null,"Issuer checked whether the QIS submission is a strategy that the issuer currently has in place for its Exchange product line and/or for other product lines."]
["Criteria 19b-c","d",null,"If issuer checked \"Yes\" for either or both of the previous two questions (i.e., the QIS is part of a mandatory State initiative and/or is a strategy the issuer currently has in place for other product lines), the issuer provided a description of the State initiative and/or its current strategy."]
["Element 20",null,"Confirm that Element 20: QIS Goals is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 20","a",null,"Issuer described at least one QIS goal."]
["Elements 17-20",null,"Determine whether Issuer met the requirements in Elements 17-20: Review the issuer's evaluation results in Column F for Part C: Data Sources Used for Goal Identification and Monitoring Progress (Element 17) and Part D: QIS Summary (Elements 18-20). ",null,"See Review Tool"]
["Elements 17-20","a",null,"The elements in Rows 29-41 are required, but not scored. If the issuer received a “No” result for any of the steps in those rows, the State may designate a review result of “Does Not Meet” and ask issuers to correct and resubmit information that is missing or was left blank. Continue to the next review step to identify other possible deficiencies."]
["QIS Requirements (Part E)"]
["Element 21\n(Required, Scored)",null,"Confirm that Element 21: Market-based Incentive Type(s) is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 21","a",null,"Issuer selected at least one market-based incentive sub-type under \"Provider Market-based Incentives,\" \"Enrollee Market-based Incentives,\" or both."]
["Element 21","b",null,"If either “In-kind incentives” or “Other provider/enrollee market-based incentives” was selected, issuer provided a description in the space(s) provided."]
["Element 22\n(Required, Scored)",null,"Confirm that Element 22: Topic Area Selection is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 22","a",null,"Issuer selected at least one topic area (e.g., improve health outcomes, prevent hospital readmissions) this QIS addresses. Issuers are required to select the \"Reduce health and health care disparities\" topic within at least one of their quality improvement strategies on file. "]
["Element 23\n(Required, Scored)",null,"Confirm that Element 23: Rationale for QIS is complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 23\n","a",null,"Issuer provided a rationale for the QIS that describes the issuer's current QHP enrollee population(s) and how the QIS will address the needs of the current QHP enrollee population(s)."]
["Element 24\n(Required, Scored)",null,"Confirm that Element 24: Activity(ies) that Will Be Conducted to Implement the QIS is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Criterion 24a","a",null,"Criterion 24a: Issuer listed the activities that will be implemented to achieve the goal(s) identified in Element 20 (QIS Description)."]
["Criterion 24b","b",null,"Criterion 24b: Issuer described how the activities listed in Criterion 24a relate to the market-based incentive selected in Element 21 (Market-based Incentive Type(s))."]
["Criterion 24c","c",null,"Criterion 24c: Issuer described how the activities listed in Criterion 24a relate to the topic area(s) selected in Element 22 (Topic Area Selection)."]
["Element 25\n(Required, Scored)",null,"Confirm that Element 25: Goal(s), Measure(s), and Performance Target(s) to Monitor QIS Progress is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 25",null,"Review Element 25: Goal 1, Measure 1a",null,"See QIS Submission"]
["Criterion 25a","a",null,"Criterion 25a: Issuer provided the name of the Measure 1a."]
["Criterion 25a","b",null,"Criterion 25a: Issuer provided a narrative description of the Measure 1a numerator and denominator."]
["Criterion 25a","c",null,"Criterion 25a: Issuer indicated whether Measure 1a is National Quality Forum (NQF)-endorsed. "]
["Criterion 25a","d",null,"Criterion 25a: If \"Yes\" was checked, indicating Measure 1a is NQF-endorsed, issuer provided the NQF ID number."]
["Criterion 25a","e",null,"Criterion 25a: If \"Yes\" was checked, indicating Measure 1a is NQF-endorsed, issuer indicated whether it modified the NQF-endorsed measure specification."]
["Criterion 25b","f",null,"Criterion 25b: Issuer described how Measure 1a supports the tracking of performance related to Goal 1."]
["Criterion 25c","g",null,"Criterion 25c: Issuer provided the Measure 1a rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 25c","h",null,"Criterion 25c: If Measure 1a is not a rate but another data point, issuer entered the number in the space provided for data point."]
["Criterion 25d","i",null,"Criterion 25d: Issuer indicated the baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment. "]
["Criterion 25e","j",null,"Criterion 25e: Issuer provided a numerical value performance target for Measure 1a (i.e., the target rate or data point the QIS intends to achieve). Note: This entry should be a rate (%) or a data point target, NOT a percentage change. "]
["Element 25",null,"Review Element 25: Goal 1, Measure 1b (if applicable)",null,"See QIS Submission"]
["Criterion 25f","a",null,"Criterion 25f: Issuer provided the name of the Measure 1b."]
["Criterion 25f","b",null,"Criterion 25f: Issuer provided a narrative description of the Measure 1b numerator and denominator."]
["Criterion 25f","c",null,"Criterion 25f: Issuer indicated whether Measure 1b is National Quality Forum (NQF)-endorsed. "]
["Criterion 25f","d",null,"Criterion 25f: If \"Yes\" was checked, indicating Measure 1a is NQF-endorsed, issuer provided the NQF ID number."]
["Criterion 25f","e",null,"Criterion 25f: If \"Yes\" was checked, indicating Measure 1b is NQF-endorsed, issuer indicated whether it modified the NQF-endorsed measure specification."]
["Criterion 25g","f",null,"Criterion 25g: Issuer described how Measure 1b supports the tracking of performance related to Goal 1."]
["Criterion 25h","g",null,"Criterion 25h: Issuer provided the Measure 1b rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 25h","h",null,"Criterion 25h: If Measure 1b is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 25i","i",null,"Criterion 25i: Issuer indicated the baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment."]
["Criterion 25j","j",null,"Criterion 25j: Issuer provided a numerical value performance target for Measure1b (i.e., the target rate or data point the QIS intends to achieve). Note: This entry should be a rate (%) or a data point target, NOT a percentage change. "]
["Element 25",null,"Review Element 24: Goal 2, Measure 2a (if applicable)",null,"See QIS Submission"]
["Criterion 25k","a",null,"Criterion 25k: Issuer provided the name of the Measure 2a."]
["Criterion 25k","b",null,"Criterion 25k: Issuer provided a narrative description of the Measure 2a numerator and denominator."]
["Criterion 25k","c",null,"Criterion 25k: Issuer indicated whether Measure 2a is National Quality Forum (NQF)-endorsed. "]
["Criterion 25k","d",null,"Criterion 25k: If \"Yes\" was checked, indicating Measure 2a is NQF-endorsed, issuer provided the NQF ID number. "]
["Criterion 25k","e",null,"Criterion 25k: If \"Yes\" was checked, indicating Measure 2a is NQF-endorsed, issuer indicated whether it modified the NQF- endorsed measure specification."]
["Criterion 25l","f",null,"Criterion 25l: Issuer described how Measure 2a supports the tracking of performance related to Goal 2."]
["Criterion 25m","g",null,"Criterion 25m: Issuer provided the Measure 2a rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 25m","h",null,"Criterion 25m: If Measure 2a is not a rate but another data point, issuer entered the number in the space provided for data point."]
["Criterion 25n","i",null,"Criterion 25n: Issuer indicated the baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment."]
["Criterion 25o","j",null,"Criterion 25o: Issuer provided a numerical value performance target for the Measure 2a (i.e., the target rate or data point the QIS intends to achieve). Note: This entry should be a rate (%) or a data point target, NOT a percentage change. "]
["Element 25",null,"Review Element 24: Goal 2, Measure 2b (if applicable)",null,"See QIS Submission"]
["Criterion 25p","a",null,"Criterion 25p: Issuer provided the name of the Measure 2b."]
["Criterion 25p","b",null,"Criterion 25p: Issuer provided a narrative description of the Measure 2b numerator and denominator."]
["Criterion 25p","c",null,"Criterion 25p: Issuer indicated whether Measure 2b is National Quality Forum (NQF)-endorsed. "]
["Criterion 25p","d",null,"Criterion 25p: If \"Yes\" was checked, indicating Measure 2b is NQF-endorsed, issuer provided the NQF ID number. "]
["Criterion 25p","e",null,"Criterion 25p: If \"Yes\" was checked, indicating Measure 2b is NQF-endorsed, issuer indicated whether it modified the NQF- endorsed measure specification."]
["Criterion 25q","f",null,"Criterion 25q: Issuer described how Measure 2b supports the tracking of performance related to Goal 2."]
["Criterion 25r","g",null,"Criterion 25r: Issuer provided the Measure 2b rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 25r","h",null,"Criterion 25r: If Measure 2b is not a rate but another data point, issuer entered the number in the space provided for data point."]
["Criterion 25s","i",null,"Criterion 25s: Issuer indicated the baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment."]
["Criterion 25t","j",null,"Criterion 25t: Issuer provided a numerical value performance target for Measure 2b (i.e., the target rate or data point the QIS intends to achieve). Note: This entry should be a rate (%) or a data point target, NOT a percentage change. "]
["Elements 21 - 25",null,"Determine whether Issuer met the requirements in Elements 21-25: Review the issuer's evaluation results in Column F for Part E: QIS Requirements (Elements 21-25). ",null,"See Review Tool"]
[null,"a",null,"If the issuer received any \"No\" results to any of the steps identified in Rows 45-100 (Elements 21-25), the issuer receives a review result of \"Does Not Meet.\" "]
["Element 26\n(Required, Scored)",null,"Confirm that Element 26: Timeline for Implementing the QIS is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Criterion 26a","a",null,"Criterion 26a: Issuer provided QIS Initiation/Start Date. Date should include month and year. QIS Initiation/Start date must be January 2023, or earlier, for continued QIS submissions and January 2024, or earlier, for new QIS submissions (see Element 1)."]
["Criterion 26b","b",null,"Criterion 26b: Issuer described at least one milestone and provided the date (month and year) for each milestone. "]
["Element 26",null,"Determine whether Issuer met the requirements in Element 26: Review the issuer's evaluation results in Column F for Element 26: Timeline for Implementing the QIS.",null,"See Review Tool"]
["Element 26","a",null,"If issuer received a single \"No\" response to either of the steps identified in Rows 104 and 105, the issuer receives a review result of \"Meets\" for this element. If both of the responses in Rows 104 and 105 are \"No\", the issuer receives a review result of \"Does Not Meet.\""]
["Element 27\n(Required, Scored)",null,"Confirm that Element 27: Risk Assessment is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Criterion 27a","a",null,"Criterion 27a: Issuer listed any known or anticipated barriers to implementing QIS activities. If no barriers were identified, issuer described how it assessed risk."]
["Criterion 27b","b",null,"Criterion 27b: Issuer described the mitigation activities that will be incorporated to address each barrier identified in Criterion 27a."]
["Element 27",null,"Determine whether Issuer met the requirements in Element 27: Review the issuer's evaluation results in Column F for Element 27: Risk Assessment. ",null,"See Review Tool"]
["Element 27","a",null,"If issuer received any \"No\" results to any of the steps identified in Rows 109 and 110, the issuer receives a review result of \"Does Not Meet\" for this element."]
["Progress Report Form (if applicable)"]
["Attestation Box 1\n(Required, Not scored)",null,"Confirm Attestation Box 1: Confirm you have reviewed your baseline QIS Implementation Plan (and associated Modification Summary, if applicable) in preparing this submission is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Attestation Box 1\n","a",null,"Issuer checked the attestation box."]
["Progress Report or Closeout QIS Submission (Part A), Issuer Information (Part B)"]
["Element 1 \n(Required, Not Scored)",null,"Confirm that Element 1: Type of QIS Submission is complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 1","a",null,"Issuer selected one QIS submission type"]
["Elements 2 - 14\n(Required, Not Scored)",null,"Confirm that Elements 2 - 14 within Part B: Issuer Information are complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Elements 2 - 14\n","a",null,"Issuer provided identifying information in each response field."]
["Element 15\n(Required, Not Scored)",null,"Confirm that Element 15: Current Payment Model(s) Description is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu."]
["Element 15","a",null,"Issuer selected one or more category(ies) of payment models that are used by the issuer across its Exchange product line."]
["Element 15\n","b",null,"If \"Fee for Service - No Link to Quality and Value\" was checked, issuer provided the percentage of payments not tied to quality and value."]
["Element 15","c",null,"If \"Fee for Service - Linked to Quality and Value\" was checked, issuer provided the percentage of payments tied to quality and value."]
["Element 15","d",null,"If \"Alternative Payment Models Build on Fee for Service Architecture\" was checked, issuer provided the percentage of payments tied to quality and value."]
["Element 15","e",null,"If \"Population-based Payment\" was checked, issuer provided the percentage of payments tied to quality and value."]
["Element 15","f",null,"Issuer confirmed the total percentage of payments across all four payment model types equals approximately 100 percent. "]
["Attestation Box 1, Elements 1-15",null,"Determine whether Issuer met the requirements in Attestation Box 1 and Elements 1-15: Review the issuer's evaluation results in Column F for Part A: New, Discontinuing, or Continuing QIS Submission and Part B: Issuer Information (Elements 1-15).",null,"See Review Tool"]
["Attestation Box 1, Elements 1-15","a",null,"Only the elements in Rows 117-128 (i.e., Attestation Box 1, Elements 1- 15) are required, but not scored. If the issuer received a “No” result for any of the steps in those rows, the State may designate a review result of “Does Not Meet” and ask issuers to correct and resubmit information that is missing or was left blank. Continue to the next review step to identify other possible deficiencies."]
["QIS Progress Report Summary (Part C)"]
["Element 16\n(Required,  Scored)",null,"Confirm that Element 16: Analyze Progress Using Baseline Data, as Documented in the Implementation Plan is complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 16",null,"Review Element 16: Goal 1",null,"See QIS Submission"]
["Element 16","a",null,"Issuer restated Goal 1 from Element 20 of their Implementation Plan on file or Criterion 8c of the Modification Summary Supplement on file, if applicable. "]
["Element  16",null,"Review Element 16: Goal 1, Measure 1a",null,"See QIS Submission"]
["Criterion 16a","a",null,"Criterion 16a: Issuer restated the name of Measure 1a from Criterion 25a of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement on file, if applicable."]
["Criterion 16b","b",null,"Criterion 16b: Issuer restated the baseline results from Criterion 25c of Measure 1a of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement on file, if applicable, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 16b","c",null,"Criterion 16b: If Measure 1a is not a rate but another data point, issuer entered the number in the space provided for data point."]
["Criterion 16c","d",null,"Criterion 16c: Issuer restated the Measure 1a baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment in Criterion 25d of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement on file, if applicable."]
["Criterion 16d","e",null,"Criterion 16d: Issuer provided the Progress Report results for Measure 1a, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 16d","f",null,"Criterion 16d: If the Measure 1a Progress Report result is not a rate but another data point, issuer entered the number in the space provided for the data point."]
["Criterion 16e","g",null,"Criterion 16e: Issuer provided the Measure 1a Progress Report performance period (i.e. month and year when data collection began and ended) covered by the progress update data assessment."]
["Criterion 16f","h",null,"Criterion 16f: Issuer restated the numerical value performance target for Measure 1a from Criterion 25e of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement on file, if applicable. Note: This entry should be a rate (%) or a data point target, NOT a percentage change."]
["Criterion 16g","i",null,"Criterion 16g: Issuer indicated whether the performance target for Measure 1a was achieved. "]
["Element 16",null,"If applicable, review Element 16: Measure 1b",null,"See QIS Submission"]
["Criterion 16h ","a",null,"Criterion 16h: Issuer restated the name of Measure 1b from Criterion 25f of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement, if applicable."]
["Criterion 16i","b",null,"Criterion 16i: Issuer restated the baseline results from Criterion 25h of Measure 1b of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement, if applicable, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 16i","c",null,"Criterion 16i: If Measure 1b is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 16j","d",null,"Criterion 16j: Issuer restated the Measure 1b baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment in Criterion 25i of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement on file, if applicable."]
["Criterion 16k","e",null,"Criterion 16k: Issuer provided the Progress Report results for Measure 1b, including the rate and providing the associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 16k","f",null,"Criterion 16k: If Measure 1b is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 16l","g",null,"Criterion 16l:  Issuer provided the Measure 1b Progress Report performance period (i.e. month and year when data collection began and ended) covered by the progress update data assessment."]
["Criterion 16m","h",null,"Criterion 16m: Issuer restated the numerical value performance target for Measure 1b from Criterion 25j of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement, if applicable. Note: This entry should be a rate (%) or a data point target, NOT a percentage change."]
["Criterion 16n","i",null,"Criterion 16n: Issuer indicated whether the performance target for Measure 1b was achieved. "]
["Element 16",null,"If applicable, review Element 16: Goal 2",null,"See QIS Submission"]
["Element 16","a",null,"Issuer restated QIS Goal 2 identified in Element 20 of the Implementation Plan on file or Criterion 8c of the Modification Summary Supplement on file, if applicable. "]
["Element  16",null,"Review Element 16: Goal 2, Measure 2a",null,"See QIS Submission"]
["Criterion 16o","a",null,"Criterion 16o: Issuer restated the name of Measure 2a from Criterion 25k of the Implementation Plan on file."]
["Criterion 16p","b",null,"Criterion 16p: Issuer restated the baseline results from Criterion 25m of Measure 2a of the Implementation Plan on file, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 16p","c",null,"Criterion 16p: If Measure 2a is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 16q","d",null,"Criterion 16q: Issuer restated the Measure 2a baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment in Criterion 25n of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement on file, if applicable."]
["Criterion 16r","e",null,"Criterion 16r: Issuer provided the Measure 2a Progress Report results, including the rate and providing the associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 16r","f",null,"Criterion 16r: If Measure 2a is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 16s","g",null,"Criterion 16s: Issuer provided the Measure 2a Progress Report performance period (i.e. month and year when data collection began and ended) covered by the progress update data assessment."]
["Criterion 16t","h",null,"Criterion 16t: Issuer restated the numerical value performance target for Measure 2a from Criterion 25o of the Implementation Plan on file. Note: This entry should be a rate (%) or a data point target, NOT a percentage change."]
["Criterion 16u","i",null,"Criterion 16u: Issuer indicated whether the performance target for Measure 2a was achieved. "]
["Element  16",null,"Review Element 16: Goal 2, Measure 2b",null,"See QIS Submission"]
["Criterion 16v","a",null,"Criterion 16v: Issuer restated the name of Measure 2b from Criterion 25p of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement, if applicable."]
["Criterion 16w","b",null,"Criterion 16w: Issuer restated the baseline results from Criterion 25r of Measure 2b of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement, if applicable, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 16w","c",null,"Criterion 16w: If Measure 2b is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 16x","d",null,"Criterion 16x: Issuer restated the Measure 2b baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment in Criterion 25s of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement on file, if applicable."]
["Criterion 16y","e",null,"Criterion 16y: Issuer provided the Measure 2b Progress Report results, including the rate and providing the associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 16y","f",null,"Criterion 16y: If Measure 2b is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 16z","g",null,"Criterion 16z: Issuer provided the Measure 2b Progress Report performance period (i.e. month and year when data collection began and ended) covered by the progress update data assessment."]
["Criterion 16aa","h",null,"Criterion 16aa: Issuer restated the numerical value performance target for Measure 2b from Criterion 25t of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement, if applicable. Note: This entry should be a rate (%) or a data point target, NOT a percentage change."]
["Criterion 16bb","i",null,"Criterion 16bb: Issuer indicated whether the performance target for Measure 2b was achieved. "]
["Element 17\n(Required, Scored)",null,"Confirm that Element 17: Summary of Progress is complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Criterion 17a","a",null,"Criterion 17a: Issuer indicated why progress was or was not made toward the performance target(s) documented in Element 25 of the Implementation Plan on file or Criterion 8e of the Modification Summary Supplement on file, if applicable.  (Note: Regardless of if an issuer made progress toward the performance target(s), the issuer is required to describe any barriers encountered in Criterion 18a and any problems meeting timelines in Criterion 18b.)"]
["Criterion 17a","b",null,"Issuer included a description of the activities that led to the outcome. "]
["Criterion 17b","c",null,"Criterion 17b: If applicable, issuer described the rationale for discontinuing the QIS."]
["Criterion 17c","d",null,"Criterion 17c: If applicable, issuer indicated which elements and/or criteria were updated based on QIS Evaluation Period Correction Report from the previous year, if applicable, and described the changes. "]
["Elements 16-17",null,"Determine whether Issuer met the requirements in Elements 16-17: Review the issuer's evaluation results in Column F for Part C: QIS Progress Report Summary (Elements 16-17).",null,"See Review Tool"]
[null,"a",null,"If the issuer received any \"No\" results to any of the steps identified in Rows 131-181, the issuer receives a review result of \"Does Not Meet.\" "]
["Element 18\n(Required, Scored)",null,"Confirm that Element 18: Barriers and Mitigation Activities is complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu."]
["Criterion 18a","a",null,"Criterion 18a: Issuer indicated whether barriers were encountered while implementing the QIS."]
["Criterion 18a","b",null,"Criterion 18a: If barriers were encountered, issuer described the barriers.\n\nNote: If the issuer's description of activities in Criterion 17a includes barriers to implementing the QIS, the issuer is still required to complete Criterion 18a and elaborate on those barriers and any other barriers in implementing\nthe QIS, if applicable."]
["Criterion 18a","c",null,"Criterion 18a: If barriers were encountered, issuer described the mitigation activities implemented to address each barrier.\n\nNote: If the issuer's description of activities in Criterion 17a includes barriers to implementing the QIS, the issuer is still required to complete Criterion 18a and elaborate on those barriers and any other barriers in implementing\nthe QIS, if applicable."]
["Criterion 18b","d",null,"Criterion 18b: Issuer indicated whether there were problems meeting timelines as indicated in Element 26 of the Implementation Plan on file."]
["Criterion 18b","e",null,"Criterion 18b: If there were problems meeting timelines, issuer described the problems in meeting timelines. \n\nNote: If the issuer's description of activities in Criterion 17a includes problems meeting timelines, the issuer is still required to complete Criterion 18b and elaborate on those problems and any other problems in meeting timelines, if applicable. "]
["Criterion 18b","f",null,"Criterion 18b: If there were problems meeting timelines, issuer described the mitigation activities implemented to address each problem in meeting the timeline.\n\nNote: If the issuer's description of activities in Criterion 17a includes problems meeting timelines, the issuer is still required to complete Criterion 18b and elaborate on those problems and any other problems in meeting timelines, if applicable. "]
["Element 18",null,"Determine whether Issuer met the requirements in Element 18: Review the issuer's evaluation results in Column F for Part C: QIS Progress Report Summary (Element 18).",null,"See Review Tool"]
[null,"a",null,"If the issuer received  \"No\" result for either Criterion 18a (review step a) or Criterion 18b (review step b) in Rows 184-190, the issuer receives a review result of \"Meet\" for this element. If the received a \"No\" result for both Criterion 18a (review step a) and Criterion 18b (review step b), the issuer receives a review result of \"Does Not Meet\"."]
["Modification Summary Supplement Form (if applicable)"]
["Attestation Box 1\n",null,"Review Attestation Box 1: Select this box if you are using this QIS Modification Summary Supplement form to add the “R educe health and health care disparities” topic area to your existing QIS on file, including any other modifications (i.e., goals, activities, measures, performance targets, product types) that result from the “Reduce health and health care disparities” topic area addition.Confirm Attestation Box 1: .",null,"See QIS Submission"]
["Attestation Box 1\n","a",null,"Issuer checked the attestation box to indicate modifications solely related to changes in topic area requirements. Unchecked box indicates issuer's modifications are not solely due to changes in topic area requirements."]
["QIS Submission (Part A), Issuer Information (Part B)"]
["Element 1 \n(Required, Not Scored)",null,"Confirm that Element 1: Type of QIS Submission is complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Element 1","a",null,"Issuer selected one QIS submission type."]
["Elements 2 - 7\n(Required, Not Scored)",null,"Confirm that Elements 2 - 7 within Part B: Issuer Information are complete; if incomplete, select \"Missing\" under the \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Elements 2 - 7\n","a",null,"Issuer provided identifying information in each response field."]
["Elements 1-7",null,"Determine whether Issuer met the requirements in Elements 1-7: Review the issuer's evaluation results in Column F for Part A: QIS Submission (Element 1) and Part B: Issuer Information (Elements 2-7).",null,"See Review Tool"]
[null,"a",null,"If the issuer received any \"No\" results to any of the steps identified in Rows 196-200, the issuer receives a review result of \"Does Not Meet.\" "]
["QIS Modification Summary (Part C)"]
["Element 8\n(Required, Scored)",null,"Confirm that Element 8: Modifying Product Types, Topic Areas, Goals, Activities, and Measures or Associated Performance Targets is complete; if incomplete, select \"Missing\" under the relevant \"Deficiency Language\" drop-down menu.",null,"See QIS Submission"]
["Criterion 8a","a",null,"Criterion 8a: Issuer selected one or more component(s) of the QIS that it is modifying for the upcoming plan year."]
["Criterion 8b","b",null,"Criterion 8b: If issuer is modifying QIS product types, Issuer indicated which product types (e.g., HMO, EPO) they are adding and/or removing from the QIS originally listed in Criterion 2b of the Implementation Plan on file."]
["Criterion 8c","c",null,"Criterion 8c: If issuer is modifying QIS topic area(s), issuer indicated whether they are adding and/or removing any topic areas to the QIS originally listed in Element 22 of the Implementation Plan on file. "]
["Criterion 8c","d",null,"Criterion 8c: If the issuer is adding a topic area(s) in Criterion 8c, they described how that topic area(s) will be addressed within the existing QIS. If the issuer remove a topic area(s), they described the rationale or reason for removing."]
["Criterion 8d","e",null,"Criterion 8d: If issuer is modifying Goal(s), Issuer indicated which Goal(s) they are modifying and stated the new Goal(s). Note: Issuers should not include specific performance targets or goals tied to a specific calendar year or plan year because this Modification Summary Supplement will remain on file, and references to specific years or performance targets will\nbecome outdated over time: "]
["Criterion 8d","f",null,"Criterion 8d: If issuer is modifying Goal(s), issuer provided a rationale for the modification(s)"]
["Criterion 8e","g",null,"Criterion 8e: If issuer is modifying activities, issuer described the modified activities."]
["Criterion 8e","h",null,"Criterion 8e: If the issuer is modifying activities, issuer provided a rationale for the modification(s)."]
["Criterion 8f","i",null,"Criterion 8f: If the issuer is modifying measures or associated performance targets in Criterion 8f, they indicated which measure(s) is being modified and stated the NEW measure(s) and performance target(s)"]
["Criterion 8f","j",null,"Criterion 8f: If the issuer is modifying measures or associated performance targets, they described the modification (e.g., remove measure, change measure or measure specifications, change target, add new measure). Note: If the issuer is removing a measure, they just need to state which measure they are removing in the text box provided; they do NOT need to fill out any further information for the measure."]
["Criterion 8f",null,"If applicable, review Criterion 8f: Measure 1a",null,"See QIS Submission"]
["Criterion 8f","a",null,"Criterion 8f: If issuer is modifying Measure 1a, issuer selected the box."]
["Criterion 8f","b",null,"Criterion 8f: If issuer is modifying Measure 1a, issuer stated the measure name."]
["Criterion 8f","c",null,"Criterion 8f: If issuer is modifying Measure 1a, issuer indicated if it is a NQF-endorsed measure."]
["Criterion 8f","d",null,"Criterion 8f: If issuer is modifying Measure 1a and it is a NQF-endorsed measure, issuer provided the 4-digit ID number. "]
["Criterion 8f","e",null,"Criterion 8f: If issuer is modifying Measure 1a, issuer provided the baseline results, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 8f","f",null,"Criterion 8f: If issuer is modifying Measure 1a and it is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 8f","g",null,"Criterion 8f: If issuer is modifying Measure 1a, issuer provided the baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment."]
["Criterion 8f","h",null,"Criterion 8f: If Issuer is modifying Measure 1a, issuer provided the NEW numerical value performance target. Note: This entry should be a rate (%) or a data point target, NOT a percentage change. "]
["Criterion 8f","i",null,"Criterion 8f: If issuer is modifying Measure 1a, issuer provided a rationale for the modifications. "]
["Criterion 8f",null,"If applicable, review Criterion 8f: Measure 1b",null,"See QIS Submission"]
["Criterion 8f","a",null,"Criterion 8f: If issuer is modifying Measure 1b, issuer selected the box."]
["Criterion 8f","b",null,"Criterion 8f: If issuer is modifying Measure 1b, issuer stated the measure name."]
["Criterion 8f","c",null,"Criterion 8f: If issuer is modifying Measure 1b, issuer indicated if it is a NQF-endorsed measure."]
["Criterion 8f","d",null,"Criterion 8f: If issuer is modifying Measure 1b and it is a NQF-endorsed measure, issuer provided the 4-digit ID number. "]
["Criterion 8f","e",null,"Criterion 8f: If issuer is modifying Measure 1b, issuer provided the baseline results, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 8f","f",null,"Criterion 8f: If issuer is modifying Measure 1b and it is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 8f","g",null,"Criterion 8f: If issuer is modifying Measure 1b, issuer provided the baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment."]
["Criterion 8f","h",null,"Criterion 8f: If issuer is modifying Measure 1b, issuer provided the NEW numerical value performance target. Note: This entry should be a rate (%) or a data point target, NOT a percentage change. "]
["Criterion 8f","i",null,"Criterion 8f: If issuer is modifying Measure 1b, issuer provided a rationale for the modifications. "]
["Criterion 8f",null,"If applicable, review Criterion 8f: Measure 2a",null,"See QIS Submission"]
["Criterion 8f","a",null,"Criterion 8f: If issuer is modifying Measure 2a, issuer selected the box."]
["Criterion 8f","b",null,"Criterion 8f: If issuer is modifying Measure 2a, issuer stated the measure name."]
["Criterion 8f","c",null,"Criterion 8f: If issuer is modifying Measure 2a, issuer indicated if it is a NQF-endorsed measure."]
["Criterion 8f","d",null,"Criterion 8f: If issuer is modifying Measure 2a and it is a NQF-endorsed measure, Issuer provided the 4-digit ID number. "]
["Criterion 8f","e",null,"Criterion 8f: If issuer is modifying Measure 2a, issuer provided the baseline results, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 8f","f",null,"Criterion 8f: If Issuer is modifying Measure 2a and it is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 8f","g",null,"Criterion 8f: If issuer is modifying Measure 2a, issuer provided the baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment."]
["Criterion 8f","h",null,"Criterion 8f: If issuer is modifying Measure 2a, issuer provided the NEW numerical value performance target. Note: This entry should be a rate (%) or a data point target, NOT a percentage change. "]
["Criterion 8f","i",null,"Criterion 8f: If issuer is modifying Measure 2a, issuer provided a rationale for the modifications. "]
["Criterion 8f",null,"If applicable, review Criterion 8f: Measure 2b",null,"See QIS Submission"]
["Criterion 8f","a",null,"Criterion 8f: If issuer is modifying Measure 2b, issuer selected the box."]
["Criterion 8f","b",null,"Criterion 8f: If issuer is modifying Measure 2b, issuer stated the measure name."]
["Criterion 8f","c",null,"Criterion 8f: If issuer is modifying Measure 2b, issuer indicated if it is a NQF-endorsed measure."]
["Criterion 8f","d",null,"Criterion 8f: If issuer is modifying Measure 2b and it is a NQF-endorsed measure, issuer provided the 4-digit ID number. "]
["Criterion 8f","e",null,"Criterion 8f: If issuer is modifying Measure 2b, issuer provided the baseline results, including the rate and associated numerator and denominator, if applicable. If a numerator and denominator are provided, they calculate to the rate provided."]
["Criterion 8f","f",null,"Criterion 8f: If issuer is modifying Measure 2b and it is not a rate but another data point, issuer entered the number in the space provided for data point. "]
["Criterion 8f","g",null,"Criterion 8f: If issuer is modifying Measure 2b, issuer provided the baseline performance period (i.e., month and year when data collection began and ended) covered by the baseline data assessment."]
["Criterion 8f","h",null,"Criterion 8f: If issuer is modifying Measure 2b, issuer provided the NEW numerical value performance target. Note: This entry should be a rate (%) or a data point target, NOT a percentage change. "]
["Criterion 8f","i",null,"Criterion 8f: If issuer is modifying Measure 2b, issuer provided a rationale for the modifications. "]
["Element 8",null,"Determine whether Issuer met the requirements in Element 8: Review the issuer's evaluation results in Column F for Part C: QIS Modification Summary (Element 8).",null,"See Review Tool"]
[null,"a",null,"If the issuer received any \"No\" results to any of the steps identified in Rows 204-254, the issuer receives a review result of \"Does Not Meet.\" "]

{"sheet":"Drop Down","index":12,"n_rows":6,"n_cols":141,"rows_kept":6,"cut":false,"hidden":true,"merged":[]}
["Review Result (Row 8)","Does Issuer Meet the Requirement? Yes/No/NA (Column F)","Missing Information or Other Elements/Criterion\n• Implementation Plan:  \n   1-19, 20 (Review Step: a), \n   25c (Review Steps: c-e), \n   25f (Review Steps: c-e), \n   25k (Review Steps: c-e), \n   25p (Review Steps: c-e), \n• Progress Report: \n   1-15\n   16g (Review Step: j)\n   16n (Review Step: j)\n   16u (Review Step: j)\n   16bb (Review Step: j)\n• Modification Summary:  \n   1-7\n   8e (Review Steps: a, c-d, i) (Goal 1, Measure 1a; Goal 1, Measure 1b; Goal 2, Measure 2a; Goal 2, Measure 2b)","IMPLEMENTATION PLAN\nPart A: New QIS Submission; Part B: Issuer Information; Part C: Data Sources Used for Goal Identification and Monitoring Progress; Part D: QIS Summary","1-20 (see column c)",null,"IMPLEMENTATION PLAN\nPart E: QIS Requirements","21 (Review Step: a)","21 (Review Step: b)",null,22,null,23,null,"24a (Review Step: a) ","24b (Review Step: b) ","24c (Review Step: c) ",null,"25a (Review Step: a)  (Goal 1, Measure 1a)","25a (Review Step: b)  (Goal 1, Measure 1a)","25b (Review Step: f) (Goal 1, Measure 1a)","25c (Review Steps: g, h) (Goal 1, Measure 1a)","25d (Review Step: i) (Goal 1, Measure 1a)","25e (Review Step: j) (Goal 1, Measure 1a)",null,"25f (Review Step: a) (Goal 1, Measure 1b)","25f (Review Step: b) (Goal 1, Measure 1b)","25g (Review Step: f) (Goal 1, Measure 1b)","25h (Review Steps: g, h) (Goal 1, Measure 1b)","25i (Review Step: i) (Goal 1, Measure 1b)","25j (Review Step: j) (Goal 1, Measure 1b)",null,"25k (Review Step: a) (Goal 2, Measure 2a)","25k (Review Step: b) (Goal 2, Measure 2a)","25l (Review Step: f) (Goal 2, Measure 2a)","25m (Review Steps: g, h) (Goal 2, Measure 2a)","25n (Review Step: i) (Goal 2, Measure 2a)","25o (Review Step: j) (Goal 2, Measure 2a)",null,"25p (Review Step: a) (Goal 2, Measure 2b)","25p (Review Step: b) (Goal 2, Measure 2b)","25q (Review Step: f) (Goal 2, Measure 2b)","25r (Review Step: g, h) (Goal 2, Measure 2b)","25s (Review Step: i) (Goal 2, Measure 2b)","25t (Review Step: j) (Goal 2, Measure 2b)",null,"26a (Review Step: a) ","26b (Review Step: b) ",null,"27a (Review Step: a) ","27b (Review Step: b) ",null,"PROGRESS REPORT\nPart A: Progress Report or Closeout QIS Submission, Part B: Issuer Information","1-15 (see column c)",null,"PROGRESS REPORT\nPart C: QIS Progress Report Summary","16 (Review Step: a) (Goal 1)","16a (Review Step: a) (Goal 1, Measure 1a)","16b (Review Steps: b, c) (Goal 1, Measure 1a)","16c (Review Step: d) (Goal 1, Measure 1a)","16d (Review Steps: e, f) (Goal 1, Measure 1a)","16e (Review Step: g) (Goal 1, Measure 1a)","16f (Review Step: h) (Goal 1, Measure 1a)","16g (Review Step: i) (Goal 1, Measure 1a)",null,"16h (Review Step: a) (Goal 1, Measure 1b)","16i (Review Steps: b, c) (Goal 1, Measure 1b)","16j (Review Step: d) (Goal 1, Measure 1b)","16k (Review Steps: e, f) (Goal 1, Measure 1b)","16l (Review Step: g) (Goal 1, Measure 1b)","16m (Review Step: h) (Goal 1, Measure 1b)","16n (Review Step: i) (Goal 1, Measure 1b)",null,"16 (Review Step: a) (Goal 2)","16o (Review Step: a) (Goal 2, Measure 2a)","16p (Review Steps: b,c) (Goal 2, Measure 2a)","16q (Review Step: d) (Goal 2, Measure 2a)","16r (Review Steps: e, f) (Goal 2, Measure 2a)","16s (Review Step: g) (Goal 2, Measure 2a)","16t (Review Step: h) (Goal 2, Measure 2a)","16u (Review Step: i) (Goal 2, Measure 2a)",null,"16v (Review Step: a) (Goal 2, Measure 2b)","16w (Review Steps: b, c) (Goal 2, Measure 2b)","16x (Review Step: d) (Goal 2, Measure 2b)","16y (Review Steps: e, f) (Goal 2, Measure 2b)","16z (Review Step: g) (Goal 2, Measure 2b)","16aa (Review Step: h) (Goal 2, Measure 2b)","16bb (Review Step: i) (Goal 2, Measure 2b)",null,"17a (Review Step: a) ","17a (Review Step: b) ","17b (Review Step: c) ","17c (Review Step: d) ",null,"18a (Review Steps: a) ","18a (Review Steps: b) ","18a (Review Steps: c) ",null,"18b (Review Steps: d) ","18b (Review Steps: e) ","18b (Review Steps: f) ",null,"MODIFICATION SUMMARY SUPPLEMENT\nPart A: QIS Submission; Part B: Issuer Information","1-7 (see column c)",null,"MODIFICATION SUMMARY SUPPLEMENT\nPart C: Modification Summary","8a (Review Step: a)","8b (Review Step: b)","8c (Review Step: c)","8c (Review Step: d)","8d (Review Step: e)","8d (Review Step: f)","8e (Review Step: g)","8e (Review Step: h)","8f (Review Step: i)","8f (Review Step: j)",null,"8f (Review Step: b) (Goal 1, Measure 1a)","8f (Review Steps: e-f) (Goal 1, Measure 1a)","8f (Review Step: g) (Goal 1, Measure 1a)","8f (Review Step: i) (Goal 1, Measure 1a)","8f (Review Step: h) (Goal 1, Measure 1a)",null,"8f (Review Step: b) (Goal 1, Measure 1b)","8f (Review Steps: e-f) (Goal 1, Measure 1b)","8f (Review Step: g) (Goal 1, Measure 1b)","8f (Review Step: h) (Goal 1, Measure 1b)","8f (Review Step: i) (Goal 1, Measure 1b)",null,"8f (Review Step: b) (Goal 2, Measure 2a)","8f (Review Step: e-f) (Goal 2, Measure 2a)","8f (Review Step: g) (Goal 2, Measure 2a)","8f (Review Step: h) (Goal 2, Measure 2a)","8f (Review Step: i) (Goal 2, Measure 2a)",null,"8f (Review Step: b) (Goal 2, Measure 2b)","8f (Review Step: e-f) (Goal 2, Measure 2b)","8f (Review Step: g) (Goal 2, Measure 2b)","8f (Review Step: h) (Goal 2, Measure 2b)","8f (Review Step: i) (Goal 2, Measure 2b)"]
["Meets","Yes","Missing Information  ",null,"Missing Information  ",null,null,"Element 21: A missing information deficiency is being tracked for this element.","Element 21: Provider “in-kind incentive” sub-type is checked, but description is not provided.",null,"Element 22: The topic area(s) selected for this QIS do not align with evidence supplied for other elements/criteria.",null,"Element 23: The rationale description does not describe the current QHP enrollee population(s).",null,"Criterion 24a: Activities that will be implemented to achieve identified goal(s) are not provided.","Criterion 24b: Activities provided do not relate to the selected market-based incentive(s) in Element 21.","Criterion 24c: Activities provided do not relate to the topic area(s) selected in Element 22.",null,"Criterion 25a (Measure 1a): Measure name does not align with numerator and/or denominator.","Criterion 25a (Measure 1a): Narrative description of the numerator and denominator is not provided.","Criterion 25b (Measure 1a): Description of how Measure 1a supports tracking of performance is not related to Goal 1.","Criterion 25c (Measure 1a): It is unclear how the value(s) provided relate(s) to the Calculated Rate.  ","Criterion 25d (Measure 1a): Performance period is not clear how it relates to the QIS goal(s).","Criterion 25e (Measure 1a): It is unclear how the performance target provided relates to the Baseline Assessment.",null,"Criterion 25f (Measure 1b): Measure name does not align with numerator and/or denominator.","Criterion 25f (Measure 1b): Narrative description of the numerator and denominator is not provided.","Criterion 25g (Measure 1b): Description of how Measure 1b supports tracking of performance is not related to Goal 1.","Criterion 25h (Measure 1b): It is unclear how the value(s) provided relate(s) to the Calculated Rate. ","Criterion 25i (Measure 1b): Performance period is not clear how it relates to the QIS goal(s).","Criterion 25j (Measure 1b): It is unclear how the performance target provided relates to the Baseline Assessment.",null,"Criterion 25k (Measure 2a): Measure name does not align with numerator and/or denominator.","Criterion 25k (Measure 2a): Narrative description of the numerator and denominator is not provided.","Criterion 25l (Measure 2a): Description of how Measure 2a supports tracking of performance is not related to Goal 2.","Criterion 25m (Measure 2a): It is unclear how the value(s) provided relate(s) to the Calculated Rate.","Criterion 25n (Measure 2a): Performance period is not clear how it relates to the QIS goal(s).","Criterion 25o (Measure 2a): It is unclear how the performance target provided relates to the Baseline Assessment.",null,"Criterion 25p (Measure 2b): Measure name does not align with numerator and/or denominator.","Criterion 25p (Measure 2b): Narrative description of the numerator and denominator is not provided.","Criterion 25q (Measure 2b): Description of how Measure 2b supports tracking of performance is not related to Goal 2.","Criterion 25r (Measure 2b): It is unclear how the value(s) provided relate(s) to the Calculated Rate. ","Criterion 25s (Measure 2b): Performance period is not clear how it relates to the QIS goal(s).","Criterion 25t (Measure 2b): It is unclear how the performance target provided relates to the Baseline Assessment.",null,"Criterion 26a: QIS Initiation/Start date invalid (date must be January 2023, or earlier, for continued QIS submissions and January 2024, or earlier, for new QIS submissions).","Criterion 26b: Milestone(s) are not related to activities described in Element 24.",null,"Criterion 27a: Barriers are not aligned with QIS.","Criterion 27b: Mitigation activities are not aligned with barriers provided in Criterion 27a.",null,null,"Missing Information  ",null,null,"Element 16 (Goal 1): Goal 1 does not match what was indicated in Element 20 of the Implementation Plan on file or Criterion 8c of the Modification Summary Supplement on file, if applicable.","Criterion 16a (Measure 1a): Measure name does not align with numerator and/or denominator.","Criterion 16b (Measure 1a): It is unclear how the value(s) provided relate(s) to the Baseline Assessment/Calculated Rate. ","Criterion 16c (Measure 1a): Performance period is not clear how it relates to the QIS goal(s).","Criterion 16d (Measure 1a): Issuer indicated the same baseline results (Criterion 16b) and Progress Report results (Criterion 16d).","Criterion 16e (Measure 1a): Performance period is not clear how it relates to the QIS goal(s).","Criterion 16f (Measure 1a): Issuer did not restate the numerical value performance target for the measure from Criterion 25e of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16g: A missing information deficiency is being tracked for this criterion. ",null,"Criterion 16h (Measure 1b): Measure name does not align with numerator and/or denominator.","Criterion 16i (Measure 1b): It is unclear how the value(s) provided relate(s) to the Baseline Assessment/Calculated Rate. ","Criterion 16j (Measure 1b): Performance period is not clear how it relates to the QIS goal(s).","Criterion 16k (Measure 1b): Issuer indicated the same baseline results (Criterion 16i) and Progress Report results (Criterion 16k).","Criterion 16l (Measure 1b): Performance period is not clear how it relates to the QIS goal(s).","Criterion 16m (Measure 1b): Issuer did not restate the numerical value performance target for the measure from Criterion 25j of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16n: A missing information deficiency is being tracked for this criterion. ",null,"Element 16 (Goal 2): Goal 2 does not match what was indicated in Element 20 of the Implementation Plan on file or Criterion 8c of the Modification Summary Supplement on file, if applicable.","Criterion 16o (Measure 2a): Measure name does not align with numerator and/or denominator.","Criterion 16p (Measure 2a): It is unclear how the value(s) provided relate(s) to the Baseline Assessment/Calculated Rate. ","Criterion 16q (Measure 2a): Performance period is not clear how it relates to the QIS goal(s).","Criterion 16r (Measure 2a): Issuer indicated the same baseline results (Criterion 16p) and Progress Report results (Criterion 16r).","Criterion 16s (Measure 2a): Performance period is not clear how it relates to the QIS goal(s).","Criterion 16t (Measure 2a): Issuer did not restate the numerical value performance target for the measure from Criterion 25o of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16u: A missing information deficiency is being tracked for this criterion. ",null,"Criterion 16v (Measure 2b): Measure name does not align with numerator and/or denominator.","Criterion 16w (Measure 2b): It is unclear how the value(s) provided relate(s) to the Baseline Assessment/Calculated Rate. ","Criterion 16x (Measure 2b): Performance period is not clear how it relates to the QIS goal(s).","Criterion 16y (Measure 2b): Issuer indicated the same baseline results (Criterion 16w) and Progress Report results (Criterion 16y).","Criterion 16z (Measure 2b): Performance period is not clear how it relates to the QIS goal(s).","Criterion 16aa (Measure 2b): Issuer did not restate the numerical value performance target for the measure from Criterion 25t of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16aa: A missing information deficiency is being tracked for this criterion. ",null,"Criterion 17a: Explanation of why progress was or was not made toward the performance target(s) documented in Element 25 of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable, is not provided.","Criterion 17a: Explanation of why progress was or was not made toward the performance target(s) documented in Element 25 of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable does not include a description of activities that led to the outcome. ","Criterion 17b: The rationale for discontinuing the QIS does not relate to the QIS.","Criterion 17c: Issuer did not indicate which elements and/or criteria were updated based on the QIS Evaluation Period Correction Report.",null,"Criterion 18a: A missing information deficiency is being tracked for this criterion. ","Criterion 18a: Issuer checked “Yes,” that barriers were encountered, but did not describe the barriers. ","Criterion 18a: Mitigation activities are not aligned with barriers provided.",null,"Criterion 18b: A missing information deficiency is being tracked for this criterion. ","Criterion 18b: Issuer checked “Yes,” that they encountered problems meeting timelines did not describe the problems in meeting timelines.","Criterion 18b: Mitigation activities are not aligned with problems meeting timelines provided.",null,null,"Missing Information  ",null,null,"Criterion 8a: A missing information deficiency is being tracked for this criterion. ","Criterion 8b: Issuer indicated in Criterion 8a that product types are being modified but did not indicate whether they are adding and/or removing any product types to the QIS originally listed in Criterion 2b of the Implementation Plan on file or 8b of the Modification Summary Supplement on file, if applicable.","Criterion 8c: Issuer indicated in Criterion 8a that topic areas are being modified but did not indicate whether they are adding and/or removing any topic areas to the QIS originally listed in Element 22 the Implementation Plan on file.","Criterion 8c: Issuer indicated that topic area(s) are being added but did not describe how the topic area(s) will be addressed within the existing QIS.","Criterion 8d: Issuer indicated in Criterion 8a that goal(s) are being modified but did not state the new goal(s) in the space provided. ","Criterion 8d: Issuer indicated in Criterion 8a that goal(s) are being modified but did not provide a rationale for the modification(s).","Criterion 8e: Issuer indicated in Criterion 8a that activities are being modified but did not describe modifications to activities.  ","Criterion 8e: Issuer indicated in Criterion 8a that activities are being modified but did not provide a rationale for the modification(s).","Criterion 8f: Issuer indicated in Criterion 8a that measures or associated performance targets are being modified but did not indicate which measure(s) are being modified.","Criterion 8f: Issuer indicated in Criterion 8a that measures or associated performance targets are being modified but did not describe modifications to measures or associated performance targets. ",null,"Criterion 8f (Measure 1a): Relationship of Measure 1a to Goal 1 stated in Element 20 of the Implementation Plan on file, or the modified Goal 1 (if applicable) in Criterion 8c of the Modification Summary Supplement on file, or in Criterion 8d of this Modification Summary Supplement, is not clear. ","Criterion 8f (Measure 1a): It is unclear how the value(s) provided relate(s) to the Calculated Rate.","Criterion 8f (Measure 1a): Performance period is not clear how it relates to the QIS goal(s) in Element 20 of the Implementation Plan on file, or Criterion 8c of the Modification Summary Supplement on file, or Criterion 8d of this Modification Summary Supplement (if applicable).","Criterion 8f (Measure 1a): It is unclear how the performance target provided relates to the Baseline Assessment.","Criterion 8f (Measure 1a): A missing information deficiency is being tracked for this element/factor. ",null,"Criterion 8f (Measure 1b): Relationship of Measure 1b to Goal 1 stated in Element 20 of the Implementation Plan on file, or the modified Goal 1 (if applicable) in Criterion 8c of the Modification Summary Supplement on file, or in Criterion 8d of this Modification Summary Supplement, is not clear. ","Criterion 8f (Measure 1b): It is unclear how the value(s) provided relate(s) to the Calculated Rate.","Criterion 8f (Measure 1b): Performance period is not clear how it relates to the QIS goal(s) in Element 20 of the Implementation Plan on file, or Criterion 8c of the Modification Summary Supplement on file, or Criterion 8d of this Modification Summary Supplement (if applicable).","Criterion 8f (Measure 1b): It is unclear how the performance target provided relates to the Baseline Assessment.","Criterion 8f (Measure 1b): A missing information deficiency is being tracked for this element/factor. ",null,"Criterion 8f (Measure 2a): Relationship of Measure 2a to Goal 1 stated in Element 20 of the Implementation Plan on file, or the modified Goal 2 (if applicable) in Criterion 8c of the Modification Summary Supplement on file, or in Criterion 8d of this Modification Summary Supplement, is not clear. ","Criterion 8f (Measure 2a): It is unclear how the value(s) provided relate(s) to the Calculated Rate.","Criterion 8f (Measure 2a): Performance period is not clear how it relates to the QIS goal(s) in Element 20 of the Implementation Plan on file, or Criterion 8c of the Modification Summary Supplement on file, or Criterion 8d of this Modification Summary Supplement (if applicable).","Criterion 8f (Measure 2a): It is unclear how the performance target provided relates to the Baseline Assessment.","Criterion 8f (Measure 2a): A missing information deficiency is being tracked for this element/factor. ",null,"Criterion 8f (Measure 2b): Relationship of Measure 2b to Goal 2 stated in Element 20 of the Implementation Plan on file, or the modified Goal 2 (if applicable) in Criterion 8c of the Modification Summary Supplement on file, or in Criterion 8d of this Modification Summary Supplement, is not clear. ","Criterion 8f (Measure 2b): It is unclear how the value(s) provided relate(s) to the Calculated Rate.","Criterion 8f (Measure 2b): Performance period is not clear how it relates to the QIS goal(s) in Element 20 of the Implementation Plan on file, or Criterion 8c of the Modification Summary Supplement on file, or Criterion 8d of this Modification Summary Supplement (if applicable).","Criterion 8f (Measure 2b): It is unclear how the performance target provided relates to the Baseline Assessment.","Criterion 8f (Measure 2b): A missing information deficiency is being tracked for this element/factor. "]
["Does Not Meet","No","Other",null,"Other",null,null,null,"Element 21: Provider “other” sub-type is checked, but description is not provided.",null,"Element 22: Issuer did not select “Reduce health and health care disparities” as a topic area within at least one QIS on file.",null,"Element 23: The rationale description is not clear about how the QIS addresses the needs of the current QHP enrollee population(s).",null,"Criterion 24a: The activities provided do not align with identified goal(s).","Criterion 24b: Description of how the activities relate to the market-based incentive does not match the activities listed in Criterion 24a.","Criterion 24c: Description of how the activities relate to the topic area(s) does not match the activities listed in Criterion 24a.",null,"Missing Information","Criterion 25a (Measure 1a): Narrative description of the numerator is not provided.","Criterion 24b (Measure 1a): Description of how the measure supports tracking of performance does not match measure listed in Criterion 25a.","Criterion 25c (Measure 1a): Numerator and denominator do not calculate to the Calculated Rate.","Criterion 25d (Measure 1a): Baseline performance period should start prior to implementation of the QIS.","Criterion 25e (Measure 1a): It is unclear what the numerical value performance target represents (i.e., rate (%) or data point, NOT a percentage change). ",null,"Missing Information","Criterion 25f (Measure 1b): Narrative description of the numerator is not provided.","Criterion 25g (Measure 1b): Description of how the measure supports tracking of performance does not match measure listed in Criterion 25f.","Criterion 25h (Measure 1b): Numerator and denominator do not calculate to the Calculated Rate.","Criterion 25i (Measure 1b): Baseline performance period should start prior to implementation of the QIS.","Criterion 25j (Measure 1b): It is unclear what the numerical value performance target represents (i.e., rate (%) or data point target, NOT a percentage change). ",null,"Missing Information","Criterion 25k (Measure 2a): Narrative description of the numerator is not provided.","Criterion 25l (Measure 2a): Description of how the measure supports tracking of performance does not match measure listed in Criterion 25k.","Criterion 25m (Measure 2a): Numerator and denominator do not calculate to the Calculated Rate.","Criterion 25n (Measure 2a): Baseline performance period should start prior to implementation of the QIS.","Criterion 25o (Measure 2a): It is unclear what the numerical value performance target represents (i.e., rate (%) or data point target, NOT a percentage change). ",null,"Missing Information","Criterion 25p (Measure 2b): Narrative description of the numerator is not provided.","Criterion 25q (Measure 2b): Description of how the measure supports tracking of performance does not match measure listed in Criterion 25p.","Criterion 25r (Measure 2b): Numerator and denominator do not calculate to the Calculated Rate.","Criterion 25s (Measure 2b): Baseline performance period should start prior to implementation of the QIS.","Criterion 25t (Measure 2b): It is unclear what the numerical value performance target represents (i.e., rate (%) or data point target, NOT a percentage change). ",null,"Missing Information","Missing Information",null,"Criterion 27a: No barriers were listed but issuer did not describe how they assessed risk.","Criterion 27b: Issuer did not describe a mitigation activity for each barrier identified in Criterion 27a. ",null,null,"Other",null,null,"Element 16 (Goal 1): Relationship of Goal 1 to the selected topic area(s) in Element 22 of the Implementation Plan on file is not clear.","Criterion 16a (Measure 1a): Measure name does not match what was indicated in Criterion 25a of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16b (Measure 1a): Baseline results do not match what was indicated in Criterion 25c of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16c (Measure 1a): Baseline performance period does not match what was indicated in Criterion 25d of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable..","Criterion 16d (Measure 1a): It is unclear how the value(s) provided relate(s) to the Baseline Assessment/Calculated Rate. ","Criterion 16e (Measure 1a): Issuer indicated the same timeframe for their Baseline (Criterion 16c) and Progress Report (Criterion 16e) performance periods. ","Missing Information",null,null,"Criterion 16h (Measure 1b): Measure name does not match what was indicated in Criterion 25f of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16i (Measure 1b): Baseline results do not match what was indicated in Criterion 25h of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16j (Measure 1b): Baseline performance period does not match what was indicated in Criterion 25i of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16k (Measure 1b): It is unclear how the value(s) provided relate(s) to the Baseline Assessment/Calculated Rate. ","Criterion 16l (Measure 1b): Issuer indicated the same timeframe for their Baseline (Criterion 16j) and Progress Report (Criterion 16l) performance periods. ","Missing Information",null,null,"Element 16 (Goal 2): Relationship of Goal 2 to the selected topic area(s) in Element 22 of the Implementation Plan on file is not clear.","Criterion 16o (Measure 2a): Measure name does not match what was indicated in Criterion 25k of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable. ","Criterion 16p (Measure 2a): Baseline results do not match what was indicated in Criterion 25m of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16q (Measure 2a): Baseline performance period does not match what was indicated in Criterion 25n of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16r (Measure 2a): It is unclear how the value(s) provided relate(s) to the Baseline Assessment/Calculated Rate. ","Criterion 16s (Measure 2a): Issuer indicated the same timeframe for their Baseline (Criterion 16q) and Progress Report (Criterion 16s) performance periods. ","Missing Information",null,null,"Criterion 16v (Measure 2b): Measure name does not match what was indicated in Criterion 25p of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable. ","Criterion 16w (Measure 2b): Baseline results do not match what was indicated in Criterion 25r of the Implementation Plan on file or the modified measures in Criterion 8f of the Modification Summary Supplement on file, if applicable.","Criterion 16x (Measure 2b): Baseline performance period does not match what was indicated in Criterion 25s of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable.","Criterion 16y (Measure 2b): It is unclear how the value(s) provided relate(s) to the Baseline Assessment/Calculated Rate. ","Criterion 16z (Measure 2b): Issuer indicated the same timeframe for their Baseline (Criterion 16x) and Progress Report (Criterion 16z) performance periods. ","Missing Information",null,null,"Missing Information","Missing Information","Missing Information","Criterion 17c: Issuer did not describe the changes made to elements and/or criteria they were instructed to address based on the QIS Evaluation Period Correction Report. ",null,"Criterion 18a: Issuer indicated “No,” that no barriers were encountered, but described barriers to implementing their QIS as part of the description of activities in Criterion 17a.","Criterion 18a: Issuer indicated they encountered barriers to implementing the QIS in Criterion 17a but did not describe or elaborate on those barriers or any other barriers in implementing the QIS, if applicable, in Criterion 18a.","Criterion 18a: Mitigation activities are not provided for each of the barriers identified.",null,"Criterion 18b: Issuer indicated “No,” that there were no problems meeting timelines, but described problems meeting timelines as part of the description of activities in Criterion 17a.","Criterion 18b: Issuer indicated they encountered problems meeting timelines in Criterion 17a but did not describe or elaborate on those problems or any other problems in meeting timelines, if applicable, in Criterion 18b.","Criterion 18b: Mitigation activities are not provided for each problem in meeting the timeline.",null,null,"Other",null,null,null,"Missing Information","Missing Information","Criterion 8c: Issuer indicated that topic area(s) are being removed but did not describe the rationale or reason for the removal.","Criterion 8d: Issuer indicated a specific performance target or goals tied to a specific calendar year or plan year. Given that the Modification Summary Supplement remains on file, issuers should not include specific years or performance targets to achieve the goal(s).","Missing Information","Missing Information","Missing Information","Criterion 8f: Issuer indicated in Criterion 8a that measures or associated performance targets are being modified but did not state the new measure(s) and performance target(s).","Missing Information",null,"Criterion 8f (Measure 1a): Measure name does not align with the topic area(s) selected for this QIS in Element 22 of the Implementation Plan on file or the modified topic area(s) (if applicable) in Criterion 8c of this Modification Summary Supplement. ","Criterion 8f (Measure 1a): Numerator and denominator do not calculate to the Calculated Rate.","Missing Information","Criterion 8f (Measure 1a): It is unclear what the numerical value performance target represents (i.e., rate (%) or data point target, NOT a percentage change).",null,null,"Criterion 8f (Measure 1b): Measure name does not align with the topic area(s) selected for this QIS in Element 22 of the Implementation Plan on file or the modified topic area(s) (if applicable) in Criterion 8c of this Modification Summary Supplement. ","Criterion 8f (Measure 1b): Numerator and denominator do not calculate to the Calculated Rate.","Missing Information","Criterion 8f (Measure 1b): It is unclear what the numerical value performance target represents (e.g., percentage, count, ratio, proportion).",null,null,"Criterion 8f (Measure 2a): Measure name does not align with the topic area(s) selected for this QIS in Element 22 of the Implementation Plan on file or the modified topic area(s) (if applicable) in Criterion 8c of this Modification Summary Supplement.","Criterion 8f (Measure 2a): Numerator and denominator do not calculate to the Calculated Rate.","Missing Information","Criterion 8f (Measure 2a): It is unclear what the numerical value performance target represents (e.g., percentage, count, ratio, proportion).",null,null,"Criterion 8f (Measure 2b): Measure name does not align with the topic area(s) selected for this QIS in Element 22 of the Implementation Plan on file or the modified topic area(s) (if applicable) in Criterion 8c of this Modification Summary Supplement.","Criterion 8f (Measure 2b): Numerator and denominator do not calculate to the Calculated Rate.","Missing Information","Criterion 8f (Measure 2b): It is unclear what the numerical value performance target represents (e.g., percentage, count, ratio, proportion)."]
["Interim Meets","NA",null,null,null,null,null,null,"Element 21: Enrollee “other” sub-type is checked, but description is not provided.",null,"Missing Information",null,"Missing Information",null,null,"Missing Information","Missing Information",null,null,"Criterion 25a (Measure 1a): Narrative description of the denominator is not provided.","Missing Information","Criterion 25c (Measure 1a): Baseline assessment results should measure an issuer’s performance prior to implementation of the QIS.","Missing Information","Missing Information",null,null,"Criterion 25f (Measure 1b): Narrative description of the denominator is not provided.","Missing Information","Criterion 25h (Measure 1b): Baseline assessment results should measure an issuer’s performance  prior to implementation of the QIS.","Missing Information","Missing Information",null,null,"Criterion 25k (Measure 2a): Narrative description of the denominator is not provided.","Missing Information","Criterion 25m (Measure 2a): Baseline assessment results should measure an issuer’s performance prior to implementation of the QIS.","Missing Information","Missing Information",null,null,"Criterion 25p (Measure 2b): Narrative description of the denominator is not provided.","Missing Information","Criterion 25r (Measure 2b): Baseline assessment results should measure an issuer’s performance prior to implementation of the QIS.","Missing Information","Missing Information",null,null,null,null,"Missing Information","Missing Information",null,null,null,null,null,"Element 16 (Goal 1): Relationship of Goal 1 to the identified measure(s) in Element 25 of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable, is not clear.","Missing Information","Criterion 16b (Measure 1a): Numerator and denominator do not calculate to the rate provided.","Missing Information","Criterion 16d (Measure 1a): It is unclear how the value(s) provided relate(s) to the Progress Report results.","Missing information",null,null,null,"Missing Information","Criterion 16i (Measure 1b): Numerator and denominator do not calculate to the rate provided.","Missing Information","Criterion 16k (Measure 1b): It is unclear how the value(s) provided relate(s) to the Progress Report results.","Missing information",null,null,null,"Element 16 (Goal 2): Relationship of Goal 2 to the identified measure(s) in Element 25 of the Implementation Plan on file or the modified measures in Criterion 8e of the Modification Summary Supplement on file, if applicable, is not clear.","Missing Information","Criterion 16p (Measure 2a): Numerator and denominator do not calculate to the rate provided.","Missing Information","Criterion 16r (Measure 2a): It is unclear how the value(s) provided relate(s) to the Progress Report results.","Missing information",null,null,null,"Missing Information","Criterion 16w (Measure 2b): Numerator and denominator do not calculate to the rate provided.","Missing Information","Criterion 16y (Measure 2b): It is unclear how the value(s) provided relate(s) to the Progress Report results.","Missing information",null,null,null,null,null,null,"Missing Information",null,null,"Criterion 18a: Barriers are not aligned with the QIS.","Missing Information",null,null,"Missing Information","Missing Information",null,null,null,null,null,null,null,null,"Missing Information","Missing Information",null,null,null,"Missing Information",null,null,"Missing Information","Missing Information",null,"Missing Information",null,null,"Missing Information","Missing Information",null,"Missing Information",null,null,"Missing Information","Missing Information",null,"Missing Information",null,null,"Missing Information","Missing Information",null,"Missing Information"]
[null,null,null,null,null,null,null,null,"Missing Information",null,null,null,null,null,null,null,null,null,null,"Criterion 25a (Measure 1a): Relationship of Measure 1a to Goal 1 is not clear.",null,"Missing Information",null,null,null,null,"Criterion 25f (Measure 1b): Relationship of Measure 1b to Goal 1 is not clear.",null,"Missing Information",null,null,null,null,"Criterion 25k (Measure 2a): Relationship of Measure 2a to Goal 2 is not clear.",null,"Missing Information",null,null,null,null,"Criterion 25p (Measure 2b): Relationship of Measure 2b to Goal 2 is not clear.",null,"Missing Information",null,null,null,null,null,null,null,null,null,null,null,null,null,"Missing information",null,"Missing Information",null,"Criterion 16d (Measure 1a): Numerator and denominator do not calculate to the rate provided.",null,null,null,null,null,"Missing Information",null,"Criterion 16k (Measure 1b): Numerator and denominator do not calculate to the rate provided.",null,null,null,null,"Missing information",null,"Missing Information",null,"Criterion 16r (Measure 2a): Numerator and denominator do not calculate to the rate provided.",null,null,null,null,null,"Missing Information",null,"Criterion 16y (Measure 2b): Numerator and denominator do not calculate to the rate provided.",null,null,null,null,null,null,null,null,null,null,"Missing Information"]
[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Missing Information",null,null,null,null,null,null,"Missing Information",null,null,null,null,null,null,"Missing Information",null,null,null,null,null,null,"Missing Information",null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,"Missing information",null,null,null,null,null,null,null,"Missing information",null,null,null,null,null,null,null,null,"Missing information",null,null,null,null,null,null,null,"Missing information"]

{"sheet":"MOOP Details","index":13,"n_rows":29,"n_cols":6,"rows_kept":29,"cut":false,"hidden":false,"merged":[[4,1,4,5],[0,1,0,5],[0,7,0,11],[1,1,1,5],[2,1,2,5],[3,1,3,5],[5,1,5,5],[6,1,6,5],[9,1,10,1],[9,2,10,2],[9,3,10,3],[9,4,10,4],[9,7,10,7],[9,8,10,8],[9,9,10,9],[9,10,10,10],[12,1,13,1],[12,2,13,2],[12,3,13,3],[12,4,13,4],[12,7,13,7],[12,8,13,8],[12,9,13,9],[12,10,13,10],[15,1,16,1],[15,2,16,2],[15,3,16,3],[15,4,16,4],[15,7,16,7],[15,8,16,8],[15,9,16,9],[15,10,16,10],[18,9,19,9],[18,10,19,10],[18,8,19,8],[18,1,19,1],[18,2,19,2],[18,3,19,3],[18,4,19,4],[18,7,19,7]]}
[null,"Maximum Out of Pocket Details"]
[]
[null,"This table shows you which data elements to compare against the MOOP thresholds when doing the MOOP Review. Go through each column to find the row with the combination of the fields that apply to a particular plan, and then compare the data elements in column F to the threshold."]
[null,"The \"Integrated/separate (medical and drug)\" column indicates whether the medical and drug MOOP are integrated or separate."]
[null,"The \"Individual/family\" column indicates whether you're looking to compare the individual MOOP or the family MOOP."]
[null,"The \"Tier/no tier (in network)\" column indicates whether the plan has multiple in-network tiers (\"Tier\") or only one in netowrk tier (\"No Tier\")"]
[null,"The \"Combined in and out of network\" column indicates whether the plan is using the combined In and Out of Network MOOP, as indicated by \"Not Applicable\" being entered for the In Network MOOP fields (\"Yes\") or has separate In Network and Out of Network MOOPs (\"No\")."]
[]
[null,"Integrated/ separate (medical and drug)","Individual/ family","Tier/no tier (in network","Combined in and out of network","Data element to compare against thresholds"]
[null,"Integrated","Individual","Tier","No","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) In Network Individual"]
[null,null,null,null,null,"Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) In Network (Tier 2) Individual"]
[null,"Integrated","Individual","No tier","No","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) In Network Individual"]
[null,"Integrated","Family","Tier","No","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) In Network Family"]
[null,null,null,null,null,"Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) In Network (Tier 2) Family"]
[null,"Integrated","Family","No tier","No","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) In Network Family"]
[null,"Separate","Individual","Tier","No","Maximum Out of Pocket for Medical EHB Benefits for In Network Individual + Maximum Out of Pocket for Drug EHB Benefits for In Network Individual"]
[null,null,null,null,null,"Maximum Out of Pocket for Medical EHB Benefits for In Network (Tier 2) Individual + Maximum Out of Pocket for Drug EHB Benefits for In Network (Tier 2) Individual"]
[null,"Separate","Individual","No tier","No","Maximum Out of Pocket for Medical EHB Benefits for In Network Individual + Maximum Out of Pocket for Drug EHB Benefit In Network Individual"]
[null,"Separate","Family","Tier","No","Maximum Out of Pocket for Medical EHB Benefits for In Network Family + Maximum Out of Pocket for Drug EHB Benefits for In Network (Tier 2) Family"]
[null,null,null,null,null,"Maximum Out of Pocket for Medical EHB Benefits for In Network (Tier 2) Family + Maximum Out of Pocket for Drug EHB Benefits for In Network (Tier 2) Family"]
[null,"Separate","Family","No tier","No","Maximum Out of Pocket for Medical EHB Benefits for In Network Family + Maximum Out of Pocket for Drug EHB Benefits for In Network (Tier 2) Family"]
[null,"Integrated","Individual","Tier","Yes","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) Combined In/Out of Network Individual"]
[null,"Integrated","Individual","No tier","Yes","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) Combined In/Out of Network Individual"]
[null,"Integrated","Family","Tier","Yes","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) Combined In/Out of Network Family"]
[null,"Integrated","Family","No tier","Yes","Maximum Out of Pocket for Medical and Drug EHB Benefits (Total) Combined In/Out of Network Family"]
[null,"Separate","Individual","Tier","Yes","Maximum Out of Pocket for EHB Benefits for Combined In/Out of Network Individual + Maximum Out of Pocket for Drug EHB Benefits for Combined In/Out of Network Individual "]
[null,"Separate","Individual","No tier","Yes","Maximum Out of Pocket for EHB Benefits for Combined In/Out of Network Individual + Maximum Out of Pocket for Drug EHB Benefits for Combined In/Out of Network Individual "]
[null,"Separate","Family","Tier","Yes","Maximum Out of Pocket for EHB Benefits for Combined In/Out of Network Family + Maximum Out of Pocket for Drug EHB Benefits for Combined In/Out of Network Family"]
[null,"Separate","Family","No tier","Yes","Maximum Out of Pocket for EHB Benefits for Combined In/Out of Network Family + Maximum Out of Pocket for Drug EHB Benefits for Combined In/Out of Network Family"]

{"sheet":"Tukey Outlier Overview","index":14,"n_rows":12,"n_cols":2,"rows_kept":12,"cut":false,"hidden":false,"merged":[]}
[]
[null,"Non-Discrimination Review Outlier Methodology"]
[null,"The outlier test used for the Non-Discrimination Cost-Sharing Outlier and Non-Discrimination Formulary Outlier reviews is a modified version of Tukey’s Outlier Test1. Tukey’s Outlier Test (also known as Tukey’s Outlier Filter or Tukey’s Method) uses quartiles to determine the outliers in a given data set. It is a commonly utilized outlier test due to its ease of use and applicability to a variety of analyses. Tukey’s Outlier Test can be used regardless of data distribution, while most other outlier tests require advance knowledge or assumptions about the data distribution."]
[null,"To find outliers, the test first finds the interquartile range (IQR) of the data set: the middle 50 percent of the data set, or the 75th percentile (Q3) minus the 25th percentile (Q1). The IQR is then multiplied by a multiplier (M), subtracted from Q1, and added to Q3. The two most commonly used multiplier values are 1.5 and 2.0 (1.5 is the default value used in the tools). The two resulting values then set the bounds for what is considered an outlier. (Anything outside of the bounds is an outlier, and anything inside the bounds is not an outlier.) Expressed mathematically, the two bounds are calculated as follows:"]
[null,"IQR = Q3 – Q1."]
[null,"Lower Bound (LB) = Q1 – (M × IQR)."]
[null,"Upper Bound (UB) = Q3 + (M × IQR)."]
[null,"One flaw of using the IQR is the potential for a zero IQR if too many data points have the same value. A zero IQR makes it impossible to identify outliers using the method described above. Although the chances of this occurring are low, it does present a potential issue. The test used for the reviews modifies Tukey's Outlier Test so that if an IQR is initially equal to zero, Q1 will be multiplied by 0.75, and Q3 will be multiplied by 1.25. This will create a spread between Q1 and Q3 and make a non-zero IQR. The rest of the test will then be performed as described above."]
[null,"Another flaw of Tukey's Outlier Test is that there needs to be at least 5 data points in a data grouping to calculate outlier bounds. If there are 4 data points or less in a data grouping, none of the data points in that grouping can be evaluated."]
[null,"Any value below the LB is considered a “low outlier,” while any value above the UB is considered a “high outlier.” For the Non-Discrimination Cost-Sharing Outlier review, Tukey’s Outlier Test is used to identify high outliers in the cost sharing fields. For the Non-Discrimination Formulary Outlier review, Tukey’s Outlier Test is used to identify low outliers in the number of un-restricted drugs for various USP classes. The test is often displayed as a “box-and-whiskers plot,” as shown below."]
[]
[null,"[1] David Hoaglin, Frederick Mosteller, and John Tukey, eds., Understanding Robust and Exploratory Data Analysis (New York: John Wiley & Sons, 1983), p. 39, 54, 62, 223."]

{"sheet":"Non-Discrimination Guidance","index":15,"n_rows":30,"n_cols":6,"rows_kept":30,"cut":false,"hidden":false,"merged":[[12,1,12,5],[0,1,0,5],[2,1,2,5],[3,1,3,5],[4,1,4,5],[5,1,5,5],[6,1,6,5],[7,1,7,5],[8,1,8,5],[9,1,9,5],[10,1,10,5],[11,1,11,5],[13,1,13,5],[14,1,14,5],[22,1,24,1],[22,2,23,2],[28,1,29,1]]}
[null,"Non-Discrimination in Benefit Design "]
[]
[null,"The intent of this guidance is to clarify non-discrimination standards and provide examples of benefit design that are potentially discriminatory under the Affordable Care Act. Ultimately, the regulator that reviews essential health benefits (EHB) and/or qualified health plan (QHP) non-discrimination will determine if a plan design is a discriminatory practice.  "]
[null,"The Affordable Care Act enacted standards that protect consumers from discrimination based on age, expected length of life, present or predicted disability, degree of medical dependency, quality of life, or health condition and prohibit issuers from designing benefits or marketing QHPs in a manner that would discourage individuals with significant health care needs from enrolling in QHPs. In addition, The Public Health Service Act (PHS) Section 2711, generally prohibits individual and group health plans from imposing lifetime or annual dollar limits on essential health benefits (listed below) offered under the plan or coverage.  Furthermore, with respect to plans that must provide coverage of the EHB package, issuers may not impose benefit-specific waiting periods.  It is also important to note that benefit designs must meet the Mental Health Parity and Addiction Equity Act (MHPAEA) requirements."]
[null,"The Essential Health Benefits:\n(1) ambulatory patient services; (2) emergency services;(3) hospitalization; (4) maternity and newborn care;(5) mental health and substance use disorder services including behavioral health treatment; (6) prescription drugs; (7) rehabilitative and habilitative services and devices;(8) laboratory services;(9) preventive and wellness services and chronic disease management; and (10) pediatric services, including oral and vision care."]
[null,"The Affordable Care Act and implementing regulations prohibit discrimination through the design of benefits, but also state that issuers should not be prevented from employing benefit designs that encourage efficient utilization and reasonable medical management techniques.  A number of benefit design features are utilized in the context of medical management, including but not limited to: "]
[null,"·         Exclusions"]
[null,"·         Cost-sharing"]
[null,"·         Medical necessity determinations"]
[null,"·         Drug formularies"]
[null,"·         Visit limits"]
[null,"·         Benefit substitution"]
[null,"·         Utilization management"]
[null,"Each of these features has the potential to be either discriminatory or an important element in a QHP’s quality and affordability, depending on how the feature is designed and administered.  CMS has identified examples of potentially discriminatory benefit design within each of these domains, as well as best practices for minimizing the discriminatory potential of these features (see Table 1). These examples are not definitively discriminatory.  As potential discrimination is assessed, issuers should consider the design of singular benefits in the context of the plan as a whole, taking into account all plan features, including maximum out of pocket (MOOP) limits. "]
[null,"Furthermore, issuers should note that EHB-benchmark plans are based on 2012 plan designs and do not necessarily reflect non-discrimination standards effective for plan years beginning on or after January 1, 2014.  When designing plans that are substantially equal to the EHB-benchmark plans, issuers should therefore ensure that benefit design also complies with the aforementioned non-discrimination requirements.  "]
[]
[null,"Examples of Potentially Discriminatory Benefit Design"]
[null,"Note. This is not an exhaustive list of examples of potentially discriminatory benefit designs.  "]
[null,"Domains","Example Benefit","Potentially Discriminatory Benefit Design Example","Reason Example Benefit Design is Potentially Discriminatory","Possible Method for Minimizing the Potential for Discrimination for the Example Provided"]
[null,"Exclusions","Transplant","Bone marrow transplants are excluded from transplant coverage, regardless of medical necessity","Excluding bone marrow transplants regardless of medical necessity may discriminate against individuals with specific conditions, including certain cancers and immune deficiency disorders, for which this procedure is a medically necessary treatment","Transplant coverage is dictated by medical evidence and consideration of patient history"]
[null,"Cost-Sharing","Emergency Room Services","Emergency room services with  significantly increasing cost-sharing burden as the number of visits increases","Increasing the cost-sharing burden with increasing emergency room visits may discriminate against individuals with certain medical conditions that reasonably necessitate more frequent emergency room usage (for example, but not limited to, asthma, sickle cell anemia, heart failure)","Emergency room services cost-sharing design that is not contingent on the frequency of service utilization "]
[null,"Medical Necessity Definitions","Speech Therapy","Medical necessity for rehabilitative speech therapy services that is defined with the use of restrictive phrases such as “recovery of lost function” or “restoration to previous levels of functioning” when habilitative speech therapy is not covered","Defining medical necessity for rehabilitative speech therapy with restrictive phrases may discriminate against individuals with health conditions that would benefit from this therapy in order to improve functionality that may have never been present (e.g. individuals with cerebral palsy) and/or to prevent further deterioration of function (e.g. multiple sclerosis)","Medical necessity for rehabilitative speech therapy services includes coverage for all conditions in which medical evidence supports the use of speech therapy services, regardless of whether this service is used to recover lost function, improve functionality that was never present, or to prevent further deterioration of function "]
[null,"Drug Formularies","Non-Preferred Brand/Specialty Drugs","Requiring consumers to receive  specialty medications particularly for certain medical conditions from mail-order pharmacies and not allowing the use of retail pharmacies  ","Eliminating access to certain specialty medications through retail pharmacies may discriminate against individuals with significant health care needs or with certain conditions, such as rheumatoid arthritis, who are eligible to receive discounts on those drugs through retail pharmacies ","Permitting consumers to use retail pharmacies when discounts are available and the cost-sharing is lower than the mail-order pharmacy option "]
[null,null,null,"Denying coverage for a single-tablet drug regimen or extended-release product that is customarily prescribed and is as effective as a multi-tablet regimen.","Without a medically appropriate reason for denial, this plan design effectively discriminates against, or discourages enrollment by, individuals who would benefit from such therapeutic options.","Allow drug regimen options for single tablet or extended-release products that benefit individuals with certain medical conditions when they are medically effective and appropriate."]
[null,null,"Non-Preferred Brand/Specialty Drugs","Placing expensive life-saving or life-prolonging drugs, for which there is no generic and/or less expensive comparable alternative treatment, in tiers with high consumer cost-sharing ","Placing high consumer cost-sharing on life-saving or life-prolonging drugs may discriminate against individuals with conditions such as HIV/AIDS for which these drugs are a necessary treatment    ","Structuring prescription drug cost-sharing design in manner that does not place disproportionate burden on individuals with specific conditions "]
[null,"Age Limits","Hearing Aids","Arbitrary age limit for hearing aids to those who are 6 years of age and younger","Age limits are discriminatory when applied to services that have been found clinically effective at all ages","Providing coverage for hearing aids based on medical necessity"]
[null,"Visit Limits","Outpatient Rehabilitation Services","The number of covered outpatient rehabilitation visits is limited without regard to best medical practices for a given condition","Limiting the number of covered outpatient rehabilitation visits without regard to medical necessity may discriminate against individuals conditions that require more rehabilitation services than are covered in order to fully regain function after certain conditions, such as stroke","The number of covered outpatient rehabilitation visits is determined by medical necessity and best medical practices"]
[null,"Benefit Substitution","Occupational Therapy","Occupational therapy substituted in order to offer more sessions of physical therapy","Removing occupational therapy may discriminate against individuals with certain conditions for which medical evidence supports the use of occupational therapy services as beneficial treatment","Benefit substitution that is actuarially equivalent to the benefit that is being replaced is within the same EHB benefit category, is not a prescription drug benefit, and does not result in effectively eliminating a benefit included in the EHB benchmark plan for a benefit applicable to a population with more favorable risk "]
[null,"Utilization Management","Non-Preferred Brand/ Specialty Drugs","Requiring prior authorization and/or step therapy for most or all drugs in drug classes such as anti-HIV protease inhibitors, and/or immune suppressants regardless of medical evidence","Requiring prior authorization and/or step therapy for most or all medications in a specific drug class may discriminate against individuals with conditions for which those drug classes are applicable, such as HIV or rheumatoid arthritis, and cause undue burden to receive necessary therapies","Using current medical evidence to establish clinically appropriate prior authorization, step therapy, or unrestricted coverage for drugs in a given drug class"]
[null,null,"Imaging (CT/PET Scans, MRIs)","Covering mammography alone and not covering breast MRIs in combination with mammography, for individuals who would benefit from breast cancer evaluation that incorporates an MRI","Denying coverage of diagnostic imaging without regard to medical evidence and necessity may discriminate against individuals who have either been previously diagnosed with or are more susceptible to developing breast cancer","Determining cancer diagnostic testing and treatment coverage based on current medical evidence and medical necessity"]

{"sheet":"Actuarial Value Guidance","index":16,"n_rows":49,"n_cols":3,"rows_kept":49,"cut":false,"hidden":false,"merged":[[5,1,5,2],[0,1,0,2],[1,1,1,2],[2,1,2,2],[3,1,3,2],[4,1,4,2],[24,1,24,2],[6,1,6,2],[9,1,9,2],[10,1,10,2],[11,1,11,2],[12,1,12,2],[16,1,16,2],[17,1,17,2],[18,1,18,2],[19,1,19,2],[21,1,21,2],[22,1,22,2],[39,1,39,2],[42,1,42,2],[46,1,46,2],[25,1,25,2],[26,1,26,2],[27,1,27,2],[30,1,30,2],[34,1,34,2],[35,1,35,2]]}
[null,"Actuarial Value Review Guidance"]
[]
[null,"Background"]
[null,"The purpose of this tab is to document the review of alternate AV calculation methods, and to outline the review of AV for both metal tier level plans and Cost Sharing Reduction (CSR) silver plan variations (i.e., plans with 73%, 87% and 94% AV) and does not include reviewing CSR silver plan variations for other cost sharing standards (see Benefit Cost Sharing tab)."]
[null,"Overview of Regulation on Calculating AV"]
[null,"45 CFR 156.135(a) requires that to calculate actuarial value (AV) to determine a level of coverage, issuers use the AV Calculator developed and made available by HHS for the given benefit year."]
[null,"45 CFR 156.135(b) allows an exception to the use of the AV Calculator if the health plan’s design is not compatible with the AV Calculator. In those cases, the issuer must use one of the two following methods to calculate AV:"]
[null,null,"(1) Estimate the fit of the plan designs into the parameters of the HHS AV Calculator and have an actuary who is a member of the American Academy of Actuaries (MAAA) certify that the plan design was fit appropriately in accordance with generally accepted actuarial principles and methodologies; or"]
[null,null,"(2) Use the AV Calculator to determine the AV for the plan provisions that fit within the HHS AV Calculator parameters and have an actuary who is a MAAA calculate and certify, in accordance with generally accepted actuarial principles and methodologies, appropriate adjustments to the AV identified by the calculator, for plan design features that deviate substantially from the parameters of the AV Calculator."]
[null,"The Centers for Medicare and Medicaid Services (CMS) released a rule, Patient Protection and Affordable Care Act; Notice of Benefit and Payment Parameters for 2024 (Final 2024 Payment Notice) which changes the AV de minimis variation ranges for metal levels of coverage previously outlined in the December 2016 final Patient Protection and Affordable Care Act; Notice of Benefit and Payment Parameters for 2018 (Final 2018 Payment Notice) at 81 FR 94058 and April 2017 final Patient Protection and Affordable Care Act; Market Stabilization that amended 45 CFR 156.140(c). For plan years beginning on or after January 1, 2024, the rule stated an allowable variation in AV of +2/-2 percentage points for bronze (except expanded bronze), silver (except individual market silver), gold and platinum plans. Expanded bronze plans (bronze plans that either cover and pay for at least one major service, other than preventive services, before the deductible, or meet the requirements to be a high deductible health plan within the meaning of 26 U.S.C. 223(c)(2)) would have an allowable variation in AV of +5/-2 percentage points. The de minimis range for individual market silver qualified health plans (QHPs) would be +2/0 percentage points, while all other silver plans would follow the +2/-2 de minimis range. The de minimis range for the income-based silver CSR plan variations would be +1/0 percentage points. "]
[null,"Overview of Qualified Health Plan Certification Instructions"]
[null,"AV can be calculated in the Plans and Benefits Template (P&BT) using an integrated version of the AV Calculator. However, certain plans may not be able to match AVs between the P&BT and the AV Calculator due limitations in the template designs or a need to display different cost sharing in the P&BT. In those cases, the issuers may submit the plan as a unique plan design in the P&BT even though it does not meet one of the exceptions at § 156.135(b). The following are the instructions for those cases."]
[null,"For plans compatible with the AV Calculator whose AV obtained from the P&BT is not identical to the AV obtained from the stand-alone AV Calculator or otherwise have plan design features that cannot be mapped from the AV Calculator to the P&BT correctly, issuers are instructed to:"]
[null,null,"--Ensure the P&BT has been completed correctly and compare the AV Calculator screenshots to the P&BT AV Calculator screenshots."]
[null,null,"--If AVs obtained from the P&BT and the stand-alone AV Calculator are BOTH within the de minimis range, then submit with P&BT AV."]
[null,null,"--If the P&BT AV is outside de minimis range, then the issuer is instructed to designate the plan as unique and submit a screen shot of the stand-alone AV Calculator."]
[null,"For more information on the P&BT and its integration with the AV Calculator, please go to the CCIIO website (http://www.qhpcertification.cms.gov)."]
[null,"Overview of Related Requirements"]
[null,"For consistency throughout a State’s insurance market, HHS recommends that a State regulator’s AV review include a review of the AV of CSR plans. The procedures for reviewing AV for CSR silver plan variations are the same as those for standard metal level plans."]
[null,"However, CSR plans have additional cost sharing requirements that go beyond AV requirements (e.g., reduced annual limits on cost sharing) at 45 C.F.R. 156.420. To assist States, HHS has developed the Cost Sharing Tool, an optional resource for reviewing CSR silver plan variations for requirements other than AV. The Cost Sharing Tool, along with the other QHP Application Review Tools, is available to States at: http://www.qhpcertification.cms.gov."]
[]
[null,"Overview of Procedures"]
[null,"Steps 1 through 5 covers the review of plan designs that the issuer believes are not compatible with the HHS AV Calculator under 45 CFR § 156.135(b). \nStep 6 covers reviews of those plans submitted in the P&BT as “Unique Plan Design = Yes” but the issuer still used the AV Calculator and submitted a screenshot with their QHP application. \nStep 7 focuses on reviewing the data integrity between the Unified Rate Review Template and the P&BT.\nStep 8 describes how to review bronze plans that use the expanded de minimis range to comply with 45 CFR § 156.140(c).\nStep 9 records findings."]
[]
[null,"Steps of Review Procedures"]
[null,"1.     Review Part III Actuarial Memorandum and Certifications (and other related supporting documents) to determine if the issuer needs an exception to the requirement of calculating AV using the HHS AV Calculator for any plan.    "]
[null,"2.     If the issuer needs an exception to the requirement that they calculate AV using the HHS AV Calculator for a plan, verify that the issuer provided required actuarial certifications given by a MAAA as required under 45 CFR 156.135(b)(2) or 45 CFR 156.135(b)(3)."]
[null,"3.     Verify that one of the two allowed methods to calculate AV was used:"]
[null,null,"a.      45 CFR 156.135(b)(2) – estimate the fit of the plan design into the parameters of the AV Calculator; or "]
[null,null,"b.     45 CFR 156.135(b)(3) – use the AV Calculator to determine the AV for the plan provisions that fit within the AV Calculator parameters and have an actuary calculate appropriate adjustments to the AV identified by the AV Calculator for plan design features that deviate substantially from the parameters of the AV Calculator."]
[null,"4.     Assess whether the AV value adjustment for each plan identified is:"]
[null,null,"a.     Made using generally accepted actuarial principles and methods;"]
[null,null,"b.     Supported; and "]
[null,null,"c.     Reasonable."]
[null,"5.     Assess whether additional review of assumptions and methods for the adjustments to the identified plan may be necessary and review as appropriate.      "]
[null,"6.     Review the AV Calculator screenshots for any plan designated in the P&BT as “Unique Plan Design = Yes” and not included in Part III Actuarial Memorandum and Certifications (and other related supporting documents) as needing an exception to the requirement that its AV be calculated using the HHS AV Calculator at 45 CFR § 156.135(b). "]
[null,null,"a.      Check that the AV in the screenshot matches the AV submitted in the \"Issuer Actuarial Value\" field in the P&BT for this plan."]
[null,null,"b.     Check that the cost sharing parameters (e.g., deductible, out-of-pocket maximum, copay, coinsurance) in the screenshot matches the values entered into the P&BT for this plan."]
[null,null,"c.    Check that the issuer used the 2024 AV Calculator for its AV calculations. (The 2024 AV Calculator includes a label at the bottom of the \"AV Calculator\" tab stating “Final 2024 AV Calculator.”)"]
[null,"7.     Check for data integrity between the Unified Rate Review Template and the P&BT. The CMS Data Integrity Tool (DIT) can help states perform this check.   "]
[null,null,"a.      Check that the “Metal” field in the Unified Rate Review Template matches the “Level of Coverage” field in the P&BT for each plan.  "]
[null,null,"b.     Check that all plans listed in the P&BT are included in the Unified Rate Review Template."]
[null,"8.     Ensure that plans with “Expanded Bronze” level of coverage in the P&BT meet requirements to use the expanded de minimis range for bronze plans. To assist States in enforcing this requirement, we have added a review to the Cost Sharing Tool that is conducted based on the data submitted in the P&BT. The following is how to manually check: "]
[null,null,"a.      Check to see if any of the following services are coverage without applying the deductible: primary care visits (including 3 primary care visits before deductible), specialist visits, inpatient hospital services, generic drugs, preferred brand drugs, specialty drugs, or emergency room services. "]
[null,null,"b.      If yes, check the associated cost-sharing rate for that service to ensure that it does not require the enrollee to pay for more than 50 percent of the coinsurance (or the equivalent copay rate)."]
[null,null,"c.     If no, check to see if the plan selected “yes” for “HSA Eligible” in the P&BT or in plan documents and otherwise meets the requirements to be a high deductible plan within the meaning of 26 U.S.C.223(c)(2)."]
[null,"9.     Record findings "]
[null,null,"a.     If the plan passes all review steps 1-8, record finding that no regulatory issues were detected."]
[null,null,"b.     If the plan does not pass one or more of the review steps 1-8, record which standard was not satisfied."]