bigcode/tokenizer-the-stack-march-sample-v2

1#version: 0.2 - Trained by `huggingface/tokenizers`2Ġ Ġ3ĠĠ ĠĠ4ĠĠĠĠ ĠĠĠĠ5ĠĠ Ġ6e r7i n8Ġ 09o n10r e11a t12s t13o r14Ġ t15e n16Ġ 117l e18Ċ ĠĠĠĠ19Ċ ĠĠĠĠĠĠĠĠ20Ġ 221s e22a n23a l24Ġ c25Ġ =26a r27i t28Ċ ĠĠĠ29i on30d e31- -32c t33m e34r o35ĊĠĠĠĠ ĠĠĠ36h e37Ġ f38) ;39ĉ ĉ40Ġ 341Ġ p42i c43i s44Ġ ,45in g46g e47Ġ {48Ġ a49s s50Ġ 451Ġ "52u t53Ġ 554en t55u r56Ġ (57/ /58Ġ 659l a60Ġ s61Ġ n62Ġ .63u n64Ġ 865Ġ b66c e67Ġ '68Ġ }69Ġ re70i d71at e72l o73Ġ *74m p75a me76Ġt he77Ġ 778Ġ 979ĊĠĠĠĠĠĠĠĠ ĠĠĠ80Ġ d81i f82Ġ <83* *84Ġ e85Ġ in86u e87t e88c o89Ċ Ġ90Ġ o91-- --92p e93u l94i l95a d96Ġ w97Ġ -98Ġ m99r i100Ġ x101= "102( )103e d104t h105ĠĠĠĠ ĠĠĠ106u s107Ġ v108ĊĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠĠ109Ċ ĉĉ110r a111u b112Ġ S113Ġ :114c k115Ċ ĉ116c h117Ġt h118l i119an d120e s121o l122at ion123e t124Ġ )125Ġt o126p t127ge t128i g129Ġ C130e l131Ġ st132ur n133u m134= =135or t136a ge137ct ion138I n139x t140o t141h t142< /143la ss144i v145Ġ T146t urn147Ġ A148t r149e w150at a151a s152ĊĠĠĠĠ Ġ153in t154y pe155Ġ $156ĊĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠ157a b158Ġ _159o de160' ,161Ġc on162l ic163a p164Ġ de165c on166Ġ se167" ,168: :169- >170i le171Ġ h172Ġ if173u p174en d175t er176o m177Ġ [178s p179R e180a m181i mp182ĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠĠ183v er184i z185n ame186Ġ /187i st188---- ----189e ct190o d191Ġ //192Ġo f193# #194Ġ I195" >196Ġf or197Ġ is198č Ċ199Ġ ]200Ġ D201Ġ P202( "203o w204Ġre turn205Ġc lass206al ue207Ċ ĊĠĠĠ208t o209it h210q u211i m212** **213ul t214e m215Ġth is216a v217Ġ and218ab le219C on220pt ion221p er222a se223( '224m ent225Ġ +226imp ort227al l228Ġ E229se t230Ġ F231Ġ @232in e233k e234( );235Ġ g236er s237Ċ Ċ238ub lic239Ġ M240i r241a ck242Ġ N243Ġ L244Ġ ;245l f246t p247j ect248d er249or m250ro m251us er252f f253st r254t a255o s256Ġ |257Ġ B258Ġ `259Ġ l260) )261d iv262Ġb e263s er264co m265S t266p ro267== ==268ar t269i me270u re271iz e272o ur273o p274f a275e st276tr ing277I N278p ut279Ġ y280. .281ht tp282E R283ĊĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠ284ul l285un ction286Ġ= >287r or288q ue289Ġp ro290Ġ< /291m a292e xt293Ġn ew294u se295Ġ &296s c297Ġ O298o ut299o c300it y301Ġ on302i re303at h304Ġe x305in d306te xt307čĊ č308Ġ \309Ġ r310Ġ or311e x312: //313Ġ #314a c315N ame316Ġ G317a y318Ġ it319l u320Ġp ublic321Ġ R322) ,323i al324ic e325s h326Ġ );327p ar328O N329Ġ* /330_ _331) .332l y333` `334f o335Ġ j336Ċĉĉ ĉĉ337th is338un t339v e340o id341re n342" :343p p344Ġ i345f ig346Ċ ĊĠĠĠĠĠĠĠ347a g348b ject349T ype350d d351P ro352d ata353o mp354Ġt r355l l356Ġst r357Ġ me358Ġ lo359f orm360Ġ an361Ġ W362Ġ U363re turn364er t365re s366o o367que st368Ċĉĉ ĉ369Ġ= =370I d371E x372-------- --------373re f374R E375ĊĠĠĠĠĠĠĠĠ Ġ376**** ****377Ġ get378Ġw ith379an ce380Ġa s381ar g382or y383Ġ >384re ate385Ġse lf386Ġin t387t ype388Ġn ame389our ce390S T391i ew392Ġf rom393Ġw h394Ġcon st395la y396http s397un d398ro w399o u400p h401ĠĠĠĠ Ġ402ig n403o st404Ġ !405Ġ V406ra y407ode l408it e409de x410Ġ H411v ent412or d413ĊĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠĠ414on e415a ct416S tring417li st418iv e419D e420Ġ %421m o422Ġc h423sp an424Ċ ĠĠ425Ġd ata426Ġf unction427t y428p ort429Ġn ot430Ġ' ,431de f432ce ss433t d434ar y435i el436ad d437u ct438ke y439ss age440d ate441E n442v ice443i p444al se445an ge446iel d447b er448co de449Ġth at450at ic451ã ģ452Ġ In453an s454b u455it ion456" )457b ut458user name459m l460or k461ar d462o re463Ġv alue464Ġ un465T o466D ata467b o468Ġ er469f t470[ '471re ss472ĊĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠ473at or474Ċ ĊĠ475Ġ} ,476' )477E N478L ist479A T480R es481an t482i o483Ġe l484le ment485A L486la b487ren t488ap p489i es490Ġre s491Ġ al492' ]493y st494č ĊĠĠĠ495Ġ le496co l497Ġse t498Ġ --499lo w500a ss501a re502an g503Ġd o504er e505at ch506en er507lo g508Ġ Ċ509il d510Ġn ull511ri v512s o513par am514il l515// //516" );517v al518yst em519O R520j s521u le522) :523e c524f ile525Ġv oid526fa ult527> <528in k529## ##530Ġv ar531Ġc om532ĊĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ533t ent534u st535a mp536it le537c lu538y n539I D540] (541==== ====542I T543A R544Ġt ype545o g546o int547se lf548Ġs h549sc ri550on g551v alue552Ġ use553ig ht554um ent555Ġ k556le ct557( $558U L559ä ¸560riv ate561p r562str ing563t ro564Ġstr ing565Ġf ile566Ġ id567av e568c he569Ġb y570s ion571i de572ce ption573lo ck574S E575Ġm a576i x577Ġel se578S er579L E580č ĊĠĠĠĠĠĠĠ581g ht582en g583m s584ad er585Ġ at586c lass587on se588li ent589o ul590> </591ro up592V alue593ri but594C h595oul d596A r597av a598Ġ) ,599clu de600en se601S e602th od603o me604Ġy ou605at us606a k607te st608Ġde f609er y610Ġ Re611r ror612en ce613n e614re ad615in al616y le617ta in618um ber619Ġtr ue620D E621ut h622Ġ! =623l ine624ï ¼625u d626ã ĥ627g er628qu ire629a ce630C ol631i b632v ar633M e634Ġp ar635ã Ĥ636m in637ow n638lo c639b e640ĠT he641m it642Ġw e643.. /644ĠS tring645S et646Ġ" ,647Ġ// /648s ize649Ġa re650n ew651Ġt est652im age653pe c654ith ub655t on656" ;657i a658Ġf alse659te d660Ġst atic661con st662us ing663k en664o b665Ġc an666`` `667e y668ac he669r c670Ġc omp671ht ml672pe ct673a st674c ur675Ġ en676st ance677p ublic678r y679E rror680() .681ate d682A N683Ġ- >684as k685P ar686g ithub687C T688Ġ he689G et690Ġ J691b r692qu al693E S694g in695Ġ] ,696Ġ end697lo ad698Ġ u699p s700Ġc ol701Ġp rivate702eng th703' ;704ĠT h705on t706' );707Ġ Ð708) );709w w710Ġ username711K ey712m d713ar ray714ĠĠĠĠ ĠĠ715ss ert716id th717Ġ& &718O bject719e mp720B u721} ,722re e723Ġo ut724lab el725p os726th er727amp le728re d729un c730Ġ up731Ġ li732b ack733F ile734Ġh ref735on ent736c ri737p y738' :739co mp740ption s741p ath742f or743w e744de d745ack age746Ex ception747ers ion748C omp749Ġ ?750il s751od ule752ur l753ri ght754******** ********755ation s756m and757o ol758co unt759ĉĉ ĉĉ760a ch761t ime762ind ow763Ġ/ **764ar ch765f er766b ase767a in768ar get769w ork770T est771as h772r ame773Ġa dd774he ck775Ġb u776l ate777ĊĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠ778I ON779R O780in clude781an n782per ty783is p784" "785Ġ: =786M E787A n788u al789T h790ã Ģ791UL L792T ext793if i794o f795() ,796if ic797g s798Ð ¾799() );800o ck801c cess802t ribut803t ing804ĠC on805lo at806Ġ import807T r808T ime809Ġer ror810r ite811o und812U n813re am814] ,815č ĊĠĠĠĠĠĠĠĠĠĠĠ816Ġa pp817+ +818s um819o unt820Ġres ult821in dex822m ary823St ate824= '825Con fig826ic ense827Ġ* *828e p829Ċ ĊĠĠĠĠĠĠĠĠĠĠĠ830v iew831U T832le an833ç ļ834V iew835le te836fa ce837i e838çļ Ħ839A t840ame ter841Ð µ842Ġv al843od y844p re845B y846Ġor g847ar k848ĊĠĠĠĠĠĠĠĠ ĠĠĠĠĠ849or g850Ġ ro851m b852it em853it ial854č Ċĉ855m ap856f rom857I te858Ġw ill859A S860Ġ-- >861il ter862Ġs er863I C864l er865Re quest866---------------- ----------------867oc ument868Ġ} );869w ord870A dd871er ror872ir st873v oid874s ub875ï¼ Į876sp ace877In fo878[ ]879. _880ff er881yn c882i se883Ġ K884Ð °885p en886um n887f unction888Ġp x889in put890Ġt ime891arg s892er n893c a894Ġc ase895Ġer r896ire ct897Ġ/ *898ut e899ect or900le ction901Ġ list902//// ////903lo b904if y905t ra906g ist907a il908oo k909E vent910Ġ z911Ġf inal912Ġn o913g ra914Ġh ave915Ġn e916Ġ la917Ġ_ _918str uct919m odel920con fig921s on922P I923at ure924() )925ĠS ystem926Ġe xt927or der928c reate929Ġ all930( (931a x932b y933te s934r it935Me ssage936v el937ĠL icense938ra w939n g940ĠN ULL941F ield942r int943Ser vice944n o945ri de946ic h947ub le948' s949iz ed950Ġre quire951Ġin ter952op y953C O954la ce955S h956l ink957Ġj ava958O T959Ġ key960sp onse961M ap962Ġa ssert963Ġle t964Ġ" >965Ġc ur966m on967pr int968ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ969F F970A D971ur ation972ag er973A C974N ode975qu ery976P ath977g le978E T979Ġc reate980a ction981/ *982p i983Con text984ic k985Ite m986n ing987Ġst d988en s989a it990le d991le t992C ode993tro l994ĠI N995Ġ( )996def ine997C om998st er999Q u1000å ı1001se d1002U ser1003č ĊĠ1004F orm1005Ġde fault1006M odel1007all y1008Ġ< <1009o k1010â Ģ1011ap i1012st ate1013re ak1014f e1015S ize1016n ode1017Ġs o1018Ġ user1019M an1020Ġ| |1021co re1022js on1023p l1024Ġ X1025U R1026ver ride1027Ð ¸1028Ñ Ĥ1029res ult1030c al1031ĠS t1032p onse1033y s1034c l1035Ġb ut1036t able1037o x1038#### ####1039Ġa b1040g r1041d b1042lic ation1043ss ion1044cri pt1045= {1046======== ========1047ut il1048Ġ ì1049mo ve1050con tent1051Ġp er1052Ġ Y1053m at1054Ar ray1055In dex1056" ]1057tro ll1058ĠP ro1059Ġo bject1060ut o1061I S1062f unc1063ra p1064im g1065Ġn il1066P E1067oo lean1068Ã ©1069E lement1070L O1071t itle1072con d1073T R1074il der1075} ;1076le ase1077ic s1078ph p1079T he1080el l1081Ċ Ċĉ1082A pp1083ate g1084l ength1085tr y1086E qual1087Ġre quest1088ä »1089val id1090H e1091' t1092Ġs ize1093s ign1094Ġc ode1095L og1096t he1097Ġ imp1098in fo1099ic es1100Ġan y1101isp lay1102Ġt ext1103C lass1104ĠTh is1105A B1106Ġch ar1107li b1108at ive1109n et1110w h1111re quest1112Ġcon fig1113Ġs ub1114"> </1115Ġ[ ]1116l d1117F O1118E D1119c re1120g roup1121and le1122sum mary1123Ġs up1124Ġy our1125an k1126q l1127us h1128( {1129n er1130Ġs pec1131to p1132n ot1133a rent1134uth or1135ĊĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠĠ ĠĠĠĠĠĠĠ1136Ċĉĉĉĉ ĉ1137p ress1138lay er1139[ "1140in ed1141en c1142/ **1143scri pt1144ĠG et1145c ord1146ust om1147d uct1148Ġlo g1149Ġw ork1150U p1151tain er1152id er1153ex port1154IN G1155w are1156Ġsh ould1157d o1158Res ult1159ent er1160Ġh as1161d u1162M A1163troll er1164Res ponse1165ĠE x1166Ġa c1167d i1168t s1169Ġp re1170ass ert1171C H1172Ġ} ;1173S ER1174ĠS e1175st art1176T O1177Ġme thod1178Ġwh en1179p oint1180Ġ array1181U N1182In ter1183m is1184Ð ½1185Ġst yle1186scri ption1187Ġr un1188a w1189te mp1190Ġth row1191', '1192Ġex pect1193Ġa d1194d oc1195Ġ( !1196O f1197ĠD e1198m age1199and ler1200EN T

Showing the first 1,200 of 48894 lines. Download the file for the rest.