,,ii #aai? ,,congress #a/ ,session ,s4 #afcc ,,9 ,,! ,,s5ate ,,( ,,! ,,unit$ ,,/ates ,may #g1 #bjbe ,mr4 ,lujn 7= himself1 ,mrs4 ,blackburn1 ,mr4 ,durb91 ,mr4 ,ris*1 & ,mr4 ,wel*7 introduc$ ! foll[+ bill2 :i* 0 read twice & ref]r$ to ! ,committee on ,comm]ce1 ,sci5ce1 & ,transportation ,a ,,bill ,to require ! ,director ( ! ,national ,in/itute ( ,/&>ds & ,te*nology to e/abli% a pilot program t uses te/b$s to develop measurem5t /&>ds = ! evaluation ( artificial intellig5ce sy/ems1 & = o!r purposes4 #a4 ,%ort title ,?is ,act may be cit$ z ! ,te/+ & ,evaluation ,sy/ems = ,tru/$ ,artificial ,intellig5ce ,act ( #bjbe or ! ,,te/ ,,ai ,act ( #bjbe4 #b4 ,def9itions ,9 ?is ,act3 7#a7 ,artificial intellig5ce sy/em ,! t]m artificial intellig5ce sy/em has ! mean+ giv5 ! t]m artificial intellig5ce 9 section #ejjb ( ! ,national ,artificial ,intellig5ce ,act ( #bjbj 7#ae ,u4,s4,c4 #idja74 7#b7 ,cov]$ =eign c\ntry ,! t]m cov]$ =eign c\ntry means-- 7,a7 ! ,p's ,republic ( ,*9a2 7,b7 ! ,russian ,f$]ation2 7,c7 ! ,democratic ,p's ,republic ( ,korea2 & 7,d7 ! ,islamic ,republic ( ,iran4 7#c7 ,director ,! t]m ,director means ! ,director ( ! ,national ,in/itute ( ,/&>ds & ,te*nology4 7#d7 ,in/itute ,! t]m ,in/itute means ! ,national ,in/itute ( ,/&>ds & ,te*nology4 7#e7 ,te/b$ ,! t]m te/b$ means a facility or me*anism equipp$ = conduct+ rigor\s1 transp>5t1 & replicable te/+ ( tools or te*nologies to evaluate ! functionality1 p]=mance1 & security ( ^? tools or te*nologies4 7#f7 ,work+ gr\p ,! t]m ,work+ ,gr\p means ! work+ gr\p e/abli%$ "u section #c7;c77#a74 #c4 ,pilot program on te/b$s = developm5t ( measurem5t /&>ds = evaluation ( artificial intellig5ce sy/ems 7a7 ,pilot program requir$ 7#a7 ,9 g5]al ,! ,director %all1 9 coord9ation ) ! ,secret>y ( ,en]gy & aft] consultation ) ! ,work+ ,gr\p1 c>ry out a pilot program ( te/b$s to assess ! feasibility & advisability ( develop+ measurem5t /&>ds = ! evaluation ( artificial intellig5ce sy/ems us$ by ,f$]al ag5cies ?r\gh ! use ( te/b$s4 7#b7 ,process ,! ,director %all c>ry out ! pilot program requir$ by p>agraph 7#a7 by build+ & demon/rat+ an it]ative process :]eby measurem5t sci5ce is advanc$ & /&>ds are develop$ us+ te/b$s 9 accordance ) subsection 7d71 & ! results ( ! te/s are review$ by /akehold]s f gov]nm5t1 ! private sector1 & academia4 7b7 ,memor&um ( ,und]/&+ 7#a7 ,9 g5]al ,n lat] ?an #ahj days aft] ! date ( ! enactm5t ( ?is ,act1 ! ,secret>y ( ,comm]ce & ! ,secret>y ( ,en]gy %all ent] into a memor&um ( und]/&+ to implem5t ! coord9ation betwe5 ! ,secret>y ( ,en]gy & ! ,director requir$ by p>agraph 7#b74 7#b7 ,requirem5ts ,! memor&um %all be suffici5t to ensure ! ,in/itute & o!r ,f$]al ag5cies h access1 z may be necess>y & z det]m9$ by ! ,secret>y ( ,en]gy1 to ! res\rces1 p]sonnel1 & facilities at ! ,dep>tm5t ( ,en]gy1 includ+ ! cross-cutt+ rese>* & developm5t programs to support ! activities ( ! pilot program require by subsection 7a77#a74 7#c7 ,r5egotiations ,n lat] ?an #b ye>s aft] ! e/abli%m5t ( ! pilot program requir$ by subsection 7a77#a71 & e #b ye>s !reaft]1 ,secret>y ( ,comm]ce & ! ,secret>y ( ,en]gy %all reassess ! memor&um ( und]/&+ to ensure t x meets ! ne$s ( ! ag5cies & adequately supports ! activities ( ! pilot program4 7c7 ,artificial ,intellig5ce ,te/+ ,work+ ,gr\p 7#a7 ,e/abli%m5t 7,a7 ,9 g5]al ,n lat] ?an #ij days aft] ! memor&um ( und]/&+ requir$ by subsection 7b77#a7 is sign$1 ! ,secret>y ( ,comm]ce %all e/abli% a work+ gr\p to provide advice to ! ,secret>y ( ,comm]ce & ! ,secret>y ( ,en]gy on ! developm5t ( measurem5t /&>ds = ! evaluation ( artificial intellig5ce sy/ems "u ! pilot program requir$ by subsection 7a74 7,b7 ,designation ,! work+ gr\p e/abli%$ "u subp>agraph 7,a7 %all be kn[n z ! ,artificial ,intellig5ce ,te/+ ,work+ ,gr\p4 7#b7 ,memb]%ip 7,a7 ,9 g5]al ,! ,work+ ,gr\p %all be compris$ ( n m ?an #aj memb]s t include ! foll[+3 7i7 ,! ,secret>y ( ,comm]ce or a designee ( ! ,secret>y ( ,comm]ce f ! ,dep>tm5t ( ,comm]ce4 7ii7 ,! ,secret>y ( ,en]gy or a designee ( ! ,secret>y ( ,en]gy f ! ,dep>tm5t ( ,en]gy4 7iii7 ,! ,director or a designee ( ! ,director f ! ,in/itute4 7iv7 ,repres5tatives f ! private sector1 z ! memb]s describ$ 9 clauses 7i7 ?r\gh 7iii7 consid] appropriate4 7v7 ,repres5tatives f academic in/itutions1 z ! memb]s describ$ 9 clauses 7i7 ?r\gh 7iii7 consid] appropriate4 7,b7 ,prohibition ,no citiz5 ( a cov]$ =eign c\ntry may s]ve z a memb] ( ! ,work+ ,gr\p4 7#c7 ,/rategy = measurem5t /&>ds 7,a7 ,9 g5]al ,n lat] ?an #a ye> aft] ! date on :i* ! ,work+ ,gr\p is e/abli%$ "u p>agraph 7#a71 ! ,work+ ,gr\p %all develop a /rategy = ! developm5t ( measurem5t /&>ds = ! evaluation ( artificial intellig5ce sy/ems4 7,b7 ,elem5ts ,! /rategy requir$ by subp>agraph 7,a7 %all-- 7i7 id5tify measurem5t /&>ds t ! memb]s ( ! ,work+ ,gr\p consid] necess>y1 includ+ /&>ds ) respect to an artificial intellig5ce sy/em =-- 7,i7 reliability2 7,,ii7 p]=mance2 7,,iii7 capability2 7,,iv7 int]pretability2 7,v7 security1 includ+ ! prop5sity ( ! sy/em = leak+ data2 7,,vi7 privacy2 7,,vii7 data bias2 & 7,,viii7 b\nds = applicability & use cases2 7ii7 include a propos$ bluepr9t = develop+ ! measurem5t /&>ds2 7iii7 id5tify ! applications or artificial intellig5ce sy/ems to :i* ! /&>ds %\ld initially apply2 & 7iv7 id5tify metrics = ! assessm5t ( ! pilot program4 7,c7 ,publication ,! ,secret>y ( ,comm]ce %all publi% on a publicly accessible website ( ! ,dep>tm5t ( ,comm]ce ! /rategy = measurem5t /&>ds requir$ by subp>agraph 7,a7 to provide ! in=mation conta9$ 9 ! /rategy to /akehold]s1 includ+ code & model develop]s1 rese>*]s1 & indu/rial us]s ( artificial intellig5ce sy/ems4 7d7 ,developm5t ( ,te/b$s = measurem5t /&>ds 7#a7 ,9 g5]al ,n lat] ?an #b ye>s aft] ! date ( ! enactm5t ( ?is ,act1 ! ,director %all1 9 collaboration ) ! ,secret>y ( ,en]gy & 9 coord9ation ) ! ,work+ ,gr\p1 develop1 9 accordance ) ! /rategy develop$ "u subsection 7c77#c77;,a71 te/b$s on :i* to demon/rate ! developm5t ( measurem5t /&>ds = ! evaluation ( artificial intellig5ce sy/ems to be us$ by ,f$]al ag5cies4 7#b7 ,exp]ts ,9 c>ry+ out p>agraph 7#a71 ! ,director may hire any exp]t ! ,director consid]s necess>y1 includ+ exp]ts f academia1 indu/ry1 & /&>ds developm5t organizations4 7e7 ,report ,n lat] ?an #ahj days aft] ! date on :i* ! ,director completes ! fir/ te/b$ demon/ration & developm5t ( measurem5t /&>ds "u subsection 7d77#a71 ! ,director %all submit to ,congress a report t-- 7#a7 reviews ! f9d+s ( ! ,director ) respect to ! initial demon/ration c>ri$ out "u ?is section2 7#b7 recomm5ds revisions to ! pilot program plan1 includ+ by id5tify+ any res\rces1 fund+1 or p]sonnel t is ne$$ to improve & cont9ue ! developm5t ( te/b$s & measurem5t /&>ds = ! evaluation ( artificial intellig5ce sy/ems = multiple applications2 & 7#c7 makes recomm5dations = legislative or adm9i/rative action to advance ! developm5t ( measurem5t /&>ds = ! evaluation ( artificial intellig5ce sy/ems4