,,ii  #aaith ,,congress  #ast ,session  
,s4 #afcc  ,,in ,,the ,,senate ,,of     
,,the ,,united ,,states  ,may #g1 #bjbe 
,mr4 ,lujn 7for himself1 ,mrs4          
,blackburn1 ,mr4 ,durbin1 ,mr4 ,risch1  
and ,mr4 ,welch7 introduced the         
following bill2 which was read twice and
 referred to the ,committee on          
,commerce1 ,science1 and ,transportation
  ,a ,,bill  ,to require the ,director  
of the ,national ,institute of          
,standards and ,technology to establish 
a pilot program that uses testbeds to   
develop measurement standards for the   
evaluation of artificial intelligence   
systems1 and for other purposes4  #a4   
,short title ,this ,act may be cited as 
the ,testing and ,evaluation ,systems   
for ,trusted ,artificial ,intelligence  
,act of #bjbe or the ,,test ,,ai ,act of
 #bjbe4  #b4 ,definitions ,in this ,act3
  7#a7 ,artificial intelligence system  
,the term artificial intelligence system
 has the meaning given the term         
artificial intelligence in section #ejjb

 of the ,national ,artificial           
,intelligence ,act of #bjbj 7#ae        
,u4,s4,c4 #idja74  7#b7 ,covered foreign
 country ,the term covered foreign      
country means--  7,a7 the ,people's     
,republic of ,china2  7,b7 the ,russian 
,federation2  7,c7 the ,democratic      
,people's ,republic of ,korea2 and  7,d7
 the ,islamic ,republic of ,iran4  7#c7 
,director ,the term ,director means the 
,director of the ,national ,institute of
 ,standards and ,technology4  7#d7      
,institute ,the term ,institute means   
the ,national ,institute of ,standards  
and ,technology4  7#e7 ,testbed ,the    
term testbed means a facility or        
mechanism equipped for conducting       
rigorous1 transparent1 and replicable   
testing of tools or technologies to     
evaluate the functionality1 performance1
 and security of those tools or         
technologies4  7#f7 ,working group ,the 
term ,working ,group means the working  
group established under section         
#c7;c77#a74  #c4 ,pilot program on      

testbeds for development of measurement 
standards for evaluation of artificial  
intelligence systems  7a7 ,pilot program
 required  7#a7 ,in general ,the        
,director shall1 in coordination with   
the ,secretary of ,energy and after     
consultation with the ,working ,group1  
carry out a pilot program of testbeds to
 assess the feasibility and advisability
 of developing measurement standards for
 the evaluation of artificial           
intelligence systems used by ,federal   
agencies through the use of testbeds4   
7#b7 ,process ,the ,director shall carry
 out the pilot program required by      
paragraph 7#a7 by building and          
demonstrating an iterative process      
whereby measurement science is advanced 
and standards are developed using       
testbeds in accordance with subsection  
7d71 and the results of the tests are   
reviewed by stakeholders from           
government1 the private sector1 and     
academia4  7b7 ,memorandum of           
,understanding  7#a7 ,in general ,not   

later than #ahj days after the date of  
the enactment of this ,act1 the         
,secretary of ,commerce and the         
,secretary of ,energy shall enter into a
 memorandum of understanding to         
implement the coordination between the  
,secretary of ,energy and the ,director 
required by paragraph 7#b74  7#b7       
,requirements ,the memorandum shall be  
sufficient to ensure the ,institute and 
other ,federal agencies have access1 as 
may be necessary and as determined by   
the ,secretary of ,energy1 to the       
resources1 personnel1 and facilities at 
the ,department of ,energy1 including   
the cross-cutting research and          
development programs to support the     
activities of the pilot program require 
by subsection 7a77#a74  7#c7            
,renegotiations ,not later than #b years
 after the establishment of the pilot   
program required by subsection 7a77#a71 
and every #b years thereafter1          
,secretary of ,commerce and the         
,secretary of ,energy shall reassess the

 memorandum of understanding to ensure  
that it meets the needs of the agencies 
and adequately supports the activities  
of the pilot program4  7c7 ,artificial  
,intelligence ,testing ,working ,group  
7#a7 ,establishment  7,a7 ,in general   
,not later than #ij days after the      
memorandum of understanding required by 
subsection 7b77#a7 is signed1 the       
,secretary of ,commerce shall establish 
a working group to provide advice to the
 ,secretary of ,commerce and the        
,secretary of ,energy on the development
 of measurement standards for the       
evaluation of artificial intelligence   
systems under the pilot program required
 by subsection 7a74  7,b7 ,designation  
,the working group established under    
subparagraph 7,a7 shall be known as the 
,artificial ,intelligence ,testing      
,working ,group4  7#b7 ,membership  7,a7
 ,in general ,the ,working ,group shall 
be comprised of not more than #aj       
members that include the following3  7i7
 ,the ,secretary of ,commerce or a      

designee of the ,secretary of ,commerce 
from the ,department of ,commerce4  7ii7
 ,the ,secretary of ,energy or a        
designee of the ,secretary of ,energy   
from the ,department of ,energy4  7iii7 
,the ,director or a designee of the     
,director from the ,institute4  7iv7    
,representatives from the private       
sector1 as the members described in     
clauses 7i7 through 7iii7 consider      
appropriate4  7v7 ,representatives from 
academic institutions1 as the members   
described in clauses 7i7 through 7iii7  
consider appropriate4  7,b7 ,prohibition
 ,no citizen of a covered foreign       
country may serve as a member of the    
,working ,group4  7#c7 ,strategy for    
measurement standards  7,a7 ,in general 
,not later than #a year after the date  
on which the ,working ,group is         
established under paragraph 7#a71 the   
,working ,group shall develop a strategy
 for the development of measurement     
standards for the evaluation of         
artificial intelligence systems4  7,b7  

,elements ,the strategy required by     
subparagraph 7,a7 shall--  7i7 identify 
measurement standards that the members  
of the ,working ,group consider         
necessary1 including standards with     
respect to an artificial intelligence   
system for-- 7,i7 reliability2  7,,ii7  
performance2  7,,iii7 capability2       
7,,iv7 interpretability2  7,v7 security1
 including the propensity of the system 
for leaking data2  7,,vi7 privacy2      
7,,vii7 data bias2 and  7,,viii7 bounds 
for applicability and use cases2  7ii7  
include a proposed blueprint for        
developing the measurement standards2   
7iii7 identify the applications or      
artificial intelligence systems to which
 the standards should initially apply2  
and  7iv7 identify metrics for the      
assessment of the pilot program4  7,c7  
,publication ,the ,secretary of         
,commerce shall publish on a publicly   
accessible website of the ,department of
 ,commerce the strategy for measurement 
standards required by subparagraph 7,a7 

to provide the information contained in 
the strategy to stakeholders1 including 
code and model developers1 researchers1 
and industrial users of artificial      
intelligence systems4  7d7 ,development 
of ,testbeds for measurement standards  
7#a7 ,in general ,not later than #b     
years after the date of the enactment of
 this ,act1 the ,director shall1 in     
collaboration with the ,secretary of    
,energy and in coordination with the    
,working ,group1 develop1 in accordance 
with the strategy developed under       
subsection 7c77#c77;,a71 testbeds on    
which to demonstrate the development of 
measurement standards for the evaluation
 of artificial intelligence systems to  
be used by ,federal agencies4  7#b7     
,experts ,in carrying out paragraph     
7#a71 the ,director may hire any expert 
the ,director considers necessary1      
including experts from academia1        
industry1 and standards development     
organizations4  7e7 ,report ,not later  
than #ahj days after the date on which  

the ,director completes the first       
testbed demonstration and development of
 measurement standards under subsection 
7d77#a71 the ,director shall submit to  
,congress a report that--  7#a7 reviews 
the findings of the ,director with      
respect to the initial demonstration    
carried out under this section2  7#b7   
recommends revisions to the pilot       
program plan1 including by identifying  
any resources1 funding1 or personnel    
that is needed to improve and continue  
the development of testbeds and         
measurement standards for the evaluation
 of artificial intelligence systems for 
multiple applications2 and  7#c7 makes  
recommendations for legislative or      
administrative action to advance the    
development of measurement standards for
 the evaluation of artificial           
intelligence systems4