,,ii #aaith ,,congress #ast ,session ,s4 #cccf ,,in ,,the ,,senate ,,of ,,the ,,united ,,states ,december #c1 #bjbe,ms4 ,hassan 7for herself and ,mr4 ,banks7 introduced the following bill2 which was read twice and referred to the ,committee on ,homeland ,security and ,governmental ,affairs ,a ,,bill ,to require the ,secretary of ,homeland ,security to carry out prize competitions to advance the science of interpretability and to develop adversarial robustness with respect to artificial intelligence products1 and for other purposes4 #a4 ,short title ,this ,act may be cited as the ,reliable ,artificial ,intelligence ,research ,act of #bjbe4 #b4 ,definitions ,in this ,act3 7#a7 ,adversarial robustness ,the term adversarial robustness means the degree to which an artificial intelligence model is able to resist attacks that would induce it to produce incorrect1 restricted1 or harmful outputs1 while maintaining integrity1 reliability1 and privacy4 7#b7 ,artificial intelligence ,the term artificial intelligence has the meaning given the term in section #ejjb of the ,national ,artificial ,intelligence ,initiative ,act of #bjbj 7#ae ,u4,s4,c4 #idja74 7#c7 ,interpretability ,the term interpretability means the degree to which humans are able to accurately understand how an artificial intelligence model makes decisions and considers inputs and how the outputs or behaviors of the model respond to a change in the inputs4 7#d7 ,red-teaming ,the term red-teaming means a structured1 interactive1 and adversarial process to test an artificial intelligence system by simulating real-world actions to find vulnerabilities or flaws in the system4 7#e7 ,secretary ,the term ,secretary means the ,secretary of ,homeland ,security4 #c4 ,prize competition for artificial intelligence interpretability research 7a7 ,prize competition required ,not later than #bgj days after the date of enactment of this ,act1 the ,secretary of ,homeland ,security shall commence carrying out at least #a prize competition under section #bd of the ,stevenson-,wydler ,technology ,innovation ,act of #aihj 7#ae ,u4,s4,c4 #cgai7 to advance the science of interpretability in a manner relevant to commercially available or widely used artificial intelligence products4 7b7 ,consultation ,in carrying out the prize competition required by subsection 7a71 the ,secretary shall consult with-- 7#a7 the ,secretary of ,commerce2 7#b7 the ,director of the ,national ,institute of ,standards and ,technology2 7#c7 the ,national ,cyber ,director2 7#d7 the ,director of the ,national ,science ,foundation2 and 7#e7 any industry expert from the artificial intelligence sector in the ,united ,states that the ,secretary considers relevant4 7c7 ,structure and evaluation criteria 7#a7 ,in general ,the ,secretary shall develop the structure and evaluation criteria for a prize competition carried out under subsection 7a7 in accordance with the primary purpose described in that subsection4 7#b7 ,competition structure ,the ,secretary may-- 7,a7 structure a competition under subsection 7a7 into #a or more phases1 including submission of interpretability frameworks1 submission of interpretable artificial intelligence models1 and unique basic research2 and 7,b7 open these phases to the same1 or to distinct1 contestant pools4 7#c7 ,evaluation considerations ,in developing the evaluation criteria for the frameworks1 models1 or methods submitted for a prize competition under subsection 7a71 the ,secretary shall consider-- 7,a7 the degree to which a submission advances broadly applicable principles of artificial intelligence interpretability2 7,b7 the practical value of a submission in making artificial intelligence more understandable and reliable in high-risk1 high-value use cases2 and 7,c7 the likelihood that the unique research submitted will create standards for artificial intelligence interpretability in the government or industry4 7d7 ,program administration ,the ,secretary may enter into contracts1 cooperative agreements1 or other agreements with for-profit or nonprofit entities or ,state1 territorial1 local1 or ,tribal agencies to design and administer any prize competition carried out under subsection 7a74 #d4 ,prize competition for artificial intelligence adversarial robustness research 7a7 ,prize competition required ,not later than #bgj days after the date of enactment of this ,act1 the ,secretary shall commence carrying out at least #a prize competition under section #bd of the ,stevenson-,wydler ,technology ,innovation ,act of #aihj 7#ae ,u4,s4,c4 #cgai7 to develop capable artificial intelligence models that are designed to exhibit adversarial robustness in circumstances necessary for at least #a high-impact1 high-risk application in government or industry4 7b7 ,consultation ,in carrying out a prize competition required by subsection 7a71 the ,secretary shall consult with-- 7#a7 the ,secretary of ,commerce2 7#b7 the ,director of the ,institute of ,standards and ,technology2 7#c7 the ,national ,cyber ,director2 7#d7 the ,director of the ,national ,science ,foundation2 7#e7 any industry expert from the artificial intelligence sector in the ,united ,states that the ,secretary considers relevant2 and 7#f7 the head of any ,federal agency who has authority or expertise in a high-impact1 high-risk application of artificial intelligence that could be an appropriate subject for a prize competition under subsection 7a74 7c7 ,structure and evaluation criteria 7#a7 ,in general ,the ,secretary shall develop the structure and evaluation criteria for a prize competition carried out under subsection 7a7 in accordance with the primary purpose described in that subsection4 7#b7 ,competition structure ,the ,secretary may-- 7,a7 structure a competition under subsection 7a7 into #a or more phases1 including submission of adversarial robustness frameworks1 submission of artificial intelligence models1 and red-teaming2 and 7,b7 open these phases to the same1 or to distinct1 contestant pools4 7#c7 ,evaluation considerations ,in developing the evaluation criteria for the frameworks1 models1 or methods submitted for a prize competition under subsection 7a71 the ,secretary shall consider-- 7,a7 the degree to which a submission advances broadly applicable principles of artificial intelligence robustness2 and 7,b7 the practical value of the submission in reducing the risk of adversarial attacks in high-risk1 high-value use cases of artificial intelligence4 7d7 ,program administration ,the ,secretary may enter into contracts1 cooperative agreements1 or other agreements with for-profit or nonprofit entities or ,state1 territorial1 local1 or ,tribal agencies to design and administer any prize competition carried out under subsection 7a74 #e4 ,tracking and reporting 7a7 ,in general ,not later than #ahj days after the date on which the first prize competition concludes1 the ,secretary shall submit to the appropriate congressional committees a report that includes-- 7#a7 an evaluation of how the results of the competitions inform the fields of interpretability and adversarial robustness2 7#b7 an assessment of any gaps in these fields identified by the ,secretary over the course of the competitions2 and 7#c7 any suggested action that ,congress should take to advance the fields of interpretability1 adversarial robustness1 and any related research4 7b7 ,appropriate congressional committees defined ,in this section1 the term appropriate congressional committees means-- 7#a7 the ,committee on ,homeland ,security and ,governmental ,affairs of the ,senate2 and 7#b7 the ,committee on ,homeland ,security of the ,house of ,representatives4 #f4 ,appropriations ,there is authorized to be appropriated to the ,secretary to carry out this section #aj1jjj1jjj for the period of fiscal years #bjbf through #bjcj4