pretty_name: Evaluation run of byroneverson/Yi-1.5-34B-Chat-abliterated
dataset_summary: "Dataset automatically created during the evaluation run of model
\ byroneverson/Yi-1.5-34B-Chat-abliterated.\n
\nThe dataset is composed of 136 configuration, each one coresponding to one of
\ the evaluated task.\n\nThe dataset has been created from 1 run(s). Each run can
\ be found as a specific split in each configuration, the split being named using
\ the timestamp of the run.The "train" split is always pointing to the latest
\ results.\n\nAn additional configuration "results" store all the aggregated results
\ of the run.\n\nTo load the details from a run, you can for instance do the following:\n\
,\n\t\"lighteval_xstory_cloze_ar_0_2025_01_23T08_24_12_065566_parquet\",\n\tsplit=\"\
train\")\n```\n\n## Latest results\n\nThese are the [latest results from run 2025-01-23T08:24:12.065566](https://huggingface.co/datasets/OALL/details_byroneverson__Yi-1.5-34B-Chat-abliterated/blob/main/results_2025-01-23T08-24-12.065566.json)(note\
\ that their might be results for other tasks in the repos if successive evals didn't\
\ cover the same tasks. You find each in the results and the \"latest\" split for\
\ each eval):\n\n```python\n{\n \"all\": {\n \"acc_norm\": 0.39277678347855827,\n\
\ \"acc_norm_stderr\": 0.03715329375955906,\n \"acc\": 0.4877564526803441,\n\
\ \"acc_stderr\": 0.012863267059205548\n },\n \"community|acva:Algeria|0\"\
: {\n \"acc_norm\": 0.5076923076923077,\n \"acc_norm_stderr\": 0.03589365940635213\n\
\ },\n \"community|acva:Ancient_Egypt|0\": {\n \"acc_norm\": 0.7301587301587301,\n\
\ \"acc_norm_stderr\": 0.025049438945858607\n },\n \"community|acva:Arab_Empire|0\"\
: {\n \"acc_norm\": 0.4716981132075472,\n \"acc_norm_stderr\": 0.0307235352490061\n\
\ },\n \"community|acva:Arabic_Architecture|0\": {\n \"acc_norm\":\
\ 0.5333333333333333,\n \"acc_norm_stderr\": 0.03581804596782232\n },\n\
\ \"community|acva:Arabic_Art|0\": {\n \"acc_norm\": 0.4717948717948718,\n\
\ \"acc_norm_stderr\": 0.035840746749208334\n },\n \"community|acva:Arabic_Astronomy|0\"\
: {\n \"acc_norm\": 0.5076923076923077,\n \"acc_norm_stderr\": 0.03589365940635213\n\
\ },\n \"community|acva:Arabic_Calligraphy|0\": {\n \"acc_norm\": 0.6823529411764706,\n\
\ \"acc_norm_stderr\": 0.02921191947723482\n },\n \"community|acva:Arabic_Ceremony|0\"\
: {\n \"acc_norm\": 0.5081081081081081,\n \"acc_norm_stderr\": 0.036855642198496893\n\
\ },\n \"community|acva:Arabic_Clothing|0\": {\n \"acc_norm\": 0.5076923076923077,\n\
\ \"acc_norm_stderr\": 0.03589365940635213\n },\n \"community|acva:Arabic_Culture|0\"\
: {\n \"acc_norm\": 0.6102564102564103,\n \"acc_norm_stderr\": 0.035014247762563705\n\
\ },\n \"community|acva:Arabic_Food|0\": {\n \"acc_norm\": 0.38974358974358975,\n\
\ \"acc_norm_stderr\": 0.03501424776256371\n },\n \"community|acva:Arabic_Funeral|0\"\
: {\n \"acc_norm\": 0.6105263157894737,\n \"acc_norm_stderr\": 0.05029529117145396\n\
\ },\n \"community|acva:Arabic_Geography|0\": {\n \"acc_norm\": 0.6,\n\
\ \"acc_norm_stderr\": 0.04082482904638628\n },\n \"community|acva:Arabic_History|0\"\
: {\n \"acc_norm\": 0.4256410256410256,\n \"acc_norm_stderr\": 0.035498710803677086\n\
\ },\n \"community|acva:Arabic_Language_Origin|0\": {\n \"acc_norm\"\
: 0.5894736842105263,\n \"acc_norm_stderr\": 0.05073863564551209\n },\n\
\ \"community|acva:Arabic_Literature|0\": {\n \"acc_norm\": 0.5862068965517241,\n\
\ \"acc_norm_stderr\": 0.041042692118062316\n },\n \"community|acva:Arabic_Math|0\"\
: {\n \"acc_norm\": 0.5333333333333333,\n \"acc_norm_stderr\": 0.03581804596782233\n\
\ },\n \"community|acva:Arabic_Medicine|0\": {\n \"acc_norm\": 0.6413793103448275,\n\
\ \"acc_norm_stderr\": 0.039966295748767186\n },\n \"community|acva:Arabic_Music|0\"\
: {\n \"acc_norm\": 0.539568345323741,\n \"acc_norm_stderr\": 0.04242933990068981\n\
\ },\n \"community|acva:Arabic_Ornament|0\": {\n \"acc_norm\": 0.4717948717948718,\n\
\ \"acc_norm_stderr\": 0.035840746749208334\n },\n \"community|acva:Arabic_Philosophy|0\"\
: {\n \"acc_norm\": 0.4896551724137931,\n \"acc_norm_stderr\": 0.04165774775728763\n\
\ },\n \"community|acva:Arabic_Physics_and_Chemistry|0\": {\n \"acc_norm\"\
: 0.48717948717948717,\n \"acc_norm_stderr\": 0.035886105231922164\n },\n\
\ \"community|acva:Arabic_Wedding|0\": {\n \"acc_norm\": 0.558974358974359,\n\
\ \"acc_norm_stderr\": 0.0356473293185358\n },\n \"community|acva:Bahrain|0\"\
: {\n \"acc_norm\": 0.6,\n \"acc_norm_stderr\": 0.07385489458759965\n\
\ },\n \"community|acva:Comoros|0\": {\n \"acc_norm\": 0.5777777777777777,\n\
\ \"acc_norm_stderr\": 0.07446027270295805\n },\n \"community|acva:Egypt_modern|0\"\
: {\n \"acc_norm\": 0.4105263157894737,\n \"acc_norm_stderr\": 0.050738635645512106\n\
\ },\n \"community|acva:InfluenceFromAncientEgypt|0\": {\n \"acc_norm\"\
: 0.5384615384615384,\n \"acc_norm_stderr\": 0.035791543525445724\n },\n\
\ \"community|acva:InfluenceFromByzantium|0\": {\n \"acc_norm\": 0.7379310344827587,\n\
\ \"acc_norm_stderr\": 0.036646663372252565\n },\n \"community|acva:InfluenceFromChina|0\"\
: {\n \"acc_norm\": 0.38974358974358975,\n \"acc_norm_stderr\": 0.03501424776256371\n\
\ },\n \"community|acva:InfluenceFromGreece|0\": {\n \"acc_norm\":\
\ 0.6358974358974359,\n \"acc_norm_stderr\": 0.034546538677863885\n },\n\
\ \"community|acva:InfluenceFromIslam|0\": {\n \"acc_norm\": 0.7448275862068966,\n\
\ \"acc_norm_stderr\": 0.03632984052707842\n },\n \"community|acva:InfluenceFromPersia|0\"\
: {\n \"acc_norm\": 0.7828571428571428,\n \"acc_norm_stderr\": 0.031256432600906624\n\
\ },\n \"community|acva:InfluenceFromRome|0\": {\n \"acc_norm\": 0.6102564102564103,\n\
\ \"acc_norm_stderr\": 0.03501424776256371\n },\n \"community|acva:Iraq|0\"\
: {\n \"acc_norm\": 0.5058823529411764,\n \"acc_norm_stderr\": 0.05455069703232772\n\
\ },\n \"community|acva:Islam_Education|0\": {\n \"acc_norm\": 0.517948717948718,\n\
\ \"acc_norm_stderr\": 0.03587477098773825\n },\n \"community|acva:Islam_branches_and_schools|0\"\
: {\n \"acc_norm\": 0.5085714285714286,\n \"acc_norm_stderr\": 0.0378993320697706\n\
\ },\n \"community|acva:Islamic_law_system|0\": {\n \"acc_norm\": 0.5282051282051282,\n\
\ \"acc_norm_stderr\": 0.035840746749208334\n },\n \"community|acva:Jordan|0\"\
: {\n \"acc_norm\": 0.4444444444444444,\n \"acc_norm_stderr\": 0.07491109582924917\n\
\ },\n \"community|acva:Kuwait|0\": {\n \"acc_norm\": 0.6222222222222222,\n\
\ \"acc_norm_stderr\": 0.07309112127323451\n },\n \"community|acva:Lebanon|0\"\
: {\n \"acc_norm\": 0.4222222222222222,\n \"acc_norm_stderr\": 0.07446027270295805\n\
\ },\n \"community|acva:Libya|0\": {\n \"acc_norm\": 0.5555555555555556,\n\
\ \"acc_norm_stderr\": 0.07491109582924914\n },\n \"community|acva:Mauritania|0\"\
: {\n \"acc_norm\": 0.37777777777777777,\n \"acc_norm_stderr\": 0.0730911212732345\n\
\ },\n \"community|acva:Mesopotamia_civilization|0\": {\n \"acc_norm\"\
: 0.4838709677419355,\n \"acc_norm_stderr\": 0.040270179608539264\n },\n\
\ \"community|acva:Morocco|0\": {\n \"acc_norm\": 0.6222222222222222,\n\
\ \"acc_norm_stderr\": 0.07309112127323451\n },\n \"community|acva:Oman|0\"\
: {\n \"acc_norm\": 0.3333333333333333,\n \"acc_norm_stderr\": 0.07106690545187012\n\
\ },\n \"community|acva:Palestine|0\": {\n \"acc_norm\": 0.4470588235294118,\n\
\ \"acc_norm_stderr\": 0.054247803536170265\n },\n \"community|acva:Qatar|0\"\
: {\n \"acc_norm\": 0.5777777777777777,\n \"acc_norm_stderr\": 0.07446027270295805\n\
\ },\n \"community|acva:Saudi_Arabia|0\": {\n \"acc_norm\": 0.5384615384615384,\n\
\ \"acc_norm_stderr\": 0.0357915435254457\n },\n \"community|acva:Somalia|0\"\
: {\n \"acc_norm\": 0.6666666666666666,\n \"acc_norm_stderr\": 0.07106690545187012\n\
\ },\n \"community|acva:Sudan|0\": {\n \"acc_norm\": 0.4444444444444444,\n\
\ \"acc_norm_stderr\": 0.07491109582924915\n },\n \"community|acva:Syria|0\"\
: {\n \"acc_norm\": 0.5333333333333333,\n \"acc_norm_stderr\": 0.0752101433090355\n\
\ },\n \"community|acva:Tunisia|0\": {\n \"acc_norm\": 0.6,\n \
\ \"acc_norm_stderr\": 0.07385489458759965\n },\n \"community|acva:United_Arab_Emirates|0\"\
: {\n \"acc_norm\": 0.5294117647058824,\n \"acc_norm_stderr\": 0.0544600058689736\n\
\ },\n \"community|acva:Yemen|0\": {\n \"acc_norm\": 0.4,\n \
\ \"acc_norm_stderr\": 0.1632993161855452\n },\n \"community|acva:communication|0\"\
: {\n \"acc_norm\": 0.5879120879120879,\n \"acc_norm_stderr\": 0.0258343667152563\n\
\ },\n \"community|acva:computer_and_phone|0\": {\n \"acc_norm\": 0.5016949152542373,\n\
\ \"acc_norm_stderr\": 0.029160424634042836\n },\n \"community|acva:daily_life|0\"\
: {\n \"acc_norm\": 0.8011869436201781,\n \"acc_norm_stderr\": 0.021773073762099047\n\
\ },\n \"community|acva:entertainment|0\": {\n \"acc_norm\": 0.7559322033898305,\n\
\ \"acc_norm_stderr\": 0.025050880690319716\n },\n \"community|alghafa:mcq_exams_test_ar|0\"\
: {\n \"acc_norm\": 0.24057450628366248,\n \"acc_norm_stderr\": 0.018127169342271113\n\
\ },\n \"community|alghafa:meta_ar_dialects|0\": {\n \"acc_norm\":\
\ 0.23892493049119556,\n \"acc_norm_stderr\": 0.00580616015547375\n },\n\
\ \"community|alghafa:meta_ar_msa|0\": {\n \"acc_norm\": 0.25251396648044694,\n\
\ \"acc_norm_stderr\": 0.014530330201468659\n },\n \"community|alghafa:multiple_choice_facts_truefalse_balanced_task|0\"\
: {\n \"acc_norm\": 0.5333333333333333,\n \"acc_norm_stderr\": 0.05799451149344531\n\
\ },\n \"community|alghafa:multiple_choice_grounded_statement_soqal_task|0\"\
: {\n \"acc_norm\": 0.32666666666666666,\n \"acc_norm_stderr\": 0.03842150156165228\n\
\ },\n \"community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0\"\
: {\n \"acc_norm\": 0.2866666666666667,\n \"acc_norm_stderr\": 0.03704603420423024\n\
\ },\n \"community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0\"\
: {\n \"acc_norm\": 0.4858036272670419,\n \"acc_norm_stderr\": 0.005590012885334055\n\
\ },\n \"community|alghafa:multiple_choice_rating_sentiment_task|0\": {\n\
\ \"acc_norm\": 0.33444537114261885,\n \"acc_norm_stderr\": 0.006093910612833501\n\
\ },\n \"community|alghafa:multiple_choice_sentiment_task|0\": {\n \
\ \"acc_norm\": 0.32383720930232557,\n \"acc_norm_stderr\": 0.011286286477970866\n\
\ },\n \"community|arabic_exams|0\": {\n \"acc_norm\": 0.24767225325884543,\n\
\ \"acc_norm_stderr\": 0.018644889871740993\n },\n \"community|arabic_mmlu:abstract_algebra|0\"\
: {\n \"acc_norm\": 0.29,\n \"acc_norm_stderr\": 0.045604802157206845\n\
\ },\n \"community|arabic_mmlu:anatomy|0\": {\n \"acc_norm\": 0.22962962962962963,\n\
\ \"acc_norm_stderr\": 0.036333844140734636\n },\n \"community|arabic_mmlu:astronomy|0\"\
: {\n \"acc_norm\": 0.23684210526315788,\n \"acc_norm_stderr\": 0.03459777606810537\n\
\ },\n \"community|arabic_mmlu:business_ethics|0\": {\n \"acc_norm\"\
: 0.29,\n \"acc_norm_stderr\": 0.04560480215720683\n },\n \"community|arabic_mmlu:clinical_knowledge|0\"\
: {\n \"acc_norm\": 0.2188679245283019,\n \"acc_norm_stderr\": 0.025447863825108618\n\
\ },\n \"community|arabic_mmlu:college_biology|0\": {\n \"acc_norm\"\
: 0.3125,\n \"acc_norm_stderr\": 0.038760854559127644\n },\n \"community|arabic_mmlu:college_chemistry|0\"\
: {\n \"acc_norm\": 0.23,\n \"acc_norm_stderr\": 0.04229525846816508\n\
\ },\n \"community|arabic_mmlu:college_computer_science|0\": {\n \"\
acc_norm\": 0.34,\n \"acc_norm_stderr\": 0.04760952285695235\n },\n \
\ \"community|arabic_mmlu:college_mathematics|0\": {\n \"acc_norm\": 0.3,\n\
\ \"acc_norm_stderr\": 0.046056618647183814\n },\n \"community|arabic_mmlu:college_medicine|0\"\
: {\n \"acc_norm\": 0.1791907514450867,\n \"acc_norm_stderr\": 0.029242513059063308\n\
\ },\n \"community|arabic_mmlu:college_physics|0\": {\n \"acc_norm\"\
: 0.20588235294117646,\n \"acc_norm_stderr\": 0.04023382273617747\n },\n\
\ \"community|arabic_mmlu:computer_security|0\": {\n \"acc_norm\": 0.27,\n\
\ \"acc_norm_stderr\": 0.0446196043338474\n },\n \"community|arabic_mmlu:conceptual_physics|0\"\
: {\n \"acc_norm\": 0.3276595744680851,\n \"acc_norm_stderr\": 0.030683020843231004\n\
\ },\n \"community|arabic_mmlu:econometrics|0\": {\n \"acc_norm\":\
\ 0.2543859649122807,\n \"acc_norm_stderr\": 0.040969851398436695\n },\n\
\ \"community|arabic_mmlu:electrical_engineering|0\": {\n \"acc_norm\"\
: 0.21379310344827587,\n \"acc_norm_stderr\": 0.034165204477475494\n },\n\
\ \"community|arabic_mmlu:elementary_mathematics|0\": {\n \"acc_norm\"\
: 0.2698412698412698,\n \"acc_norm_stderr\": 0.022860838309232072\n },\n\
\ \"community|arabic_mmlu:formal_logic|0\": {\n \"acc_norm\": 0.2619047619047619,\n\
\ \"acc_norm_stderr\": 0.039325376803928724\n },\n \"community|arabic_mmlu:global_facts|0\"\
: {\n \"acc_norm\": 0.31,\n \"acc_norm_stderr\": 0.04648231987117316\n\
\ },\n \"community|arabic_mmlu:high_school_biology|0\": {\n \"acc_norm\"\
: 0.2032258064516129,\n \"acc_norm_stderr\": 0.02289168798455496\n },\n\
\ \"community|arabic_mmlu:high_school_chemistry|0\": {\n \"acc_norm\"\
: 0.17733990147783252,\n \"acc_norm_stderr\": 0.026874337276808352\n },\n\
\ \"community|arabic_mmlu:high_school_computer_science|0\": {\n \"acc_norm\"\
: 0.32,\n \"acc_norm_stderr\": 0.04688261722621503\n },\n \"community|arabic_mmlu:high_school_european_history|0\"\
: {\n \"acc_norm\": 0.22424242424242424,\n \"acc_norm_stderr\": 0.032568666616811015\n\
\ },\n \"community|arabic_mmlu:high_school_geography|0\": {\n \"acc_norm\"\
: 0.23232323232323232,\n \"acc_norm_stderr\": 0.03008862949021749\n },\n\
\ \"community|arabic_mmlu:high_school_government_and_politics|0\": {\n \
\ \"acc_norm\": 0.19170984455958548,\n \"acc_norm_stderr\": 0.028408953626245296\n\
\ },\n \"community|arabic_mmlu:high_school_macroeconomics|0\": {\n \
\ \"acc_norm\": 0.18974358974358974,\n \"acc_norm_stderr\": 0.019880165406588778\n\
\ },\n \"community|arabic_mmlu:high_school_mathematics|0\": {\n \"\
acc_norm\": 0.21851851851851853,\n \"acc_norm_stderr\": 0.025195752251823782\n\
\ },\n \"community|arabic_mmlu:high_school_microeconomics|0\": {\n \
\ \"acc_norm\": 0.226890756302521,\n \"acc_norm_stderr\": 0.02720537153827948\n\
\ },\n \"community|arabic_mmlu:high_school_physics|0\": {\n \"acc_norm\"\
: 0.2980132450331126,\n \"acc_norm_stderr\": 0.037345356767871984\n },\n\
\ \"community|arabic_mmlu:high_school_psychology|0\": {\n \"acc_norm\"\
: 0.20550458715596331,\n \"acc_norm_stderr\": 0.01732435232501601\n },\n\
\ \"community|arabic_mmlu:high_school_statistics|0\": {\n \"acc_norm\"\
: 0.18055555555555555,\n \"acc_norm_stderr\": 0.026232878971491652\n },\n\
\ \"community|arabic_mmlu:high_school_us_history|0\": {\n \"acc_norm\"\
: 0.24509803921568626,\n \"acc_norm_stderr\": 0.03019028245350195\n },\n\
\ \"community|arabic_mmlu:high_school_world_history|0\": {\n \"acc_norm\"\
: 0.25738396624472576,\n \"acc_norm_stderr\": 0.02845882099146029\n },\n\
\ \"community|arabic_mmlu:human_aging|0\": {\n \"acc_norm\": 0.3004484304932735,\n\
\ \"acc_norm_stderr\": 0.03076935200822914\n },\n \"community|arabic_mmlu:human_sexuality|0\"\
: {\n \"acc_norm\": 0.31297709923664124,\n \"acc_norm_stderr\": 0.04066962905677697\n\
\ },\n \"community|arabic_mmlu:international_law|0\": {\n \"acc_norm\"\
: 0.23140495867768596,\n \"acc_norm_stderr\": 0.03849856098794088\n },\n\
\ \"community|arabic_mmlu:jurisprudence|0\": {\n \"acc_norm\": 0.25925925925925924,\n\
\ \"acc_norm_stderr\": 0.042365112580946336\n },\n \"community|arabic_mmlu:logical_fallacies|0\"\
: {\n \"acc_norm\": 0.19631901840490798,\n \"acc_norm_stderr\": 0.031207970394709215\n\
\ },\n \"community|arabic_mmlu:machine_learning|0\": {\n \"acc_norm\"\
: 0.25,\n \"acc_norm_stderr\": 0.04109974682633932\n },\n \"community|arabic_mmlu:management|0\"\
: {\n \"acc_norm\": 0.1941747572815534,\n \"acc_norm_stderr\": 0.039166677628225836\n\
\ },\n \"community|arabic_mmlu:marketing|0\": {\n \"acc_norm\": 0.29914529914529914,\n\
\ \"acc_norm_stderr\": 0.029996951858349497\n },\n \"community|arabic_mmlu:medical_genetics|0\"\
: {\n \"acc_norm\": 0.31,\n \"acc_norm_stderr\": 0.04648231987117316\n\
\ },\n \"community|arabic_mmlu:miscellaneous|0\": {\n \"acc_norm\"\
: 0.24904214559386972,\n \"acc_norm_stderr\": 0.015464676163395965\n },\n\
\ \"community|arabic_mmlu:moral_disputes|0\": {\n \"acc_norm\": 0.2543352601156069,\n\
\ \"acc_norm_stderr\": 0.02344582627654555\n },\n \"community|arabic_mmlu:moral_scenarios|0\"\
: {\n \"acc_norm\": 0.26145251396648045,\n \"acc_norm_stderr\": 0.014696599650364555\n\
\ },\n \"community|arabic_mmlu:nutrition|0\": {\n \"acc_norm\": 0.26143790849673204,\n\
\ \"acc_norm_stderr\": 0.025160998214292456\n },\n \"community|arabic_mmlu:philosophy|0\"\
: {\n \"acc_norm\": 0.2057877813504823,\n \"acc_norm_stderr\": 0.022961339906764237\n\
\ },\n \"community|arabic_mmlu:prehistory|0\": {\n \"acc_norm\": 0.2716049382716049,\n\
\ \"acc_norm_stderr\": 0.02474862449053738\n },\n \"community|arabic_mmlu:professional_accounting|0\"\
: {\n \"acc_norm\": 0.23404255319148937,\n \"acc_norm_stderr\": 0.025257861359432414\n\
\ },\n \"community|arabic_mmlu:professional_law|0\": {\n \"acc_norm\"\
: 0.24967405475880053,\n \"acc_norm_stderr\": 0.011054538377832322\n },\n\
\ \"community|arabic_mmlu:professional_medicine|0\": {\n \"acc_norm\"\
: 0.20220588235294118,\n \"acc_norm_stderr\": 0.024398192986654924\n },\n\
\ \"community|arabic_mmlu:professional_psychology|0\": {\n \"acc_norm\"\
: 0.25,\n \"acc_norm_stderr\": 0.01751781884501444\n },\n \"community|arabic_mmlu:public_relations|0\"\
: {\n \"acc_norm\": 0.18181818181818182,\n \"acc_norm_stderr\": 0.036942843353378024\n\
\ },\n \"community|arabic_mmlu:security_studies|0\": {\n \"acc_norm\"\
: 0.20408163265306123,\n \"acc_norm_stderr\": 0.025801283475090503\n },\n\
\ \"community|arabic_mmlu:sociology|0\": {\n \"acc_norm\": 0.24378109452736318,\n\
\ \"acc_norm_stderr\": 0.030360490154014645\n },\n \"community|arabic_mmlu:us_foreign_policy|0\"\
: {\n \"acc_norm\": 0.3,\n \"acc_norm_stderr\": 0.046056618647183814\n\
\ },\n \"community|arabic_mmlu:virology|0\": {\n \"acc_norm\": 0.27710843373493976,\n\
\ \"acc_norm_stderr\": 0.03484331592680588\n },\n \"community|arabic_mmlu:world_religions|0\"\
: {\n \"acc_norm\": 0.32748538011695905,\n \"acc_norm_stderr\": 0.035993357714560276\n\
\ },\n \"community|arc_challenge_okapi_ar|0\": {\n \"acc_norm\": 0.2681034482758621,\n\
\ \"acc_norm_stderr\": 0.013011708714624957\n },\n \"community|arc_easy_ar|0\"\
: {\n \"acc_norm\": 0.2521150592216582,\n \"acc_norm_stderr\": 0.008932744808153058\n\
\ },\n \"community|boolq_ar|0\": {\n \"acc_norm\": 0.6168711656441718,\n\
\ \"acc_norm_stderr\": 0.008515839629223856\n },\n \"community|copa_ext_ar|0\"\
: {\n \"acc_norm\": 0.4777777777777778,\n \"acc_norm_stderr\": 0.05294752255076824\n\
\ },\n \"community|hellaswag_okapi_ar|0\": {\n \"acc_norm\": 0.25264420455784536,\n\
\ \"acc_norm_stderr\": 0.004537678325622731\n },\n \"community|openbook_qa_ext_ar|0\"\
: {\n \"acc_norm\": 0.3212121212121212,\n \"acc_norm_stderr\": 0.021008716833566338\n\
\ },\n \"community|piqa_ar|0\": {\n \"acc_norm\": 0.508456082924168,\n\
\ \"acc_norm_stderr\": 0.011680062105905479\n },\n \"community|race_ar|0\"\
: {\n \"acc_norm\": 0.26820856157435585,\n \"acc_norm_stderr\": 0.0063109484249868585\n\
\ },\n \"community|sciq_ar|0\": {\n \"acc_norm\": 0.32964824120603015,\n\
\ \"acc_norm_stderr\": 0.014910203327095755\n },\n \"community|toxigen_ar|0\"\
: {\n \"acc_norm\": 0.4320855614973262,\n \"acc_norm_stderr\": 0.01620887578524445\n\
\ },\n \"lighteval|xstory_cloze:ar|0\": {\n \"acc\": 0.4877564526803441,\n\
\ \"acc_stderr\": 0.012863267059205548\n },\n \"community|acva:_average|0\"\
: {\n \"acc_norm\": 0.548080543554616,\n \"acc_norm_stderr\": 0.04825322544543206\n\
\ },\n \"community|alghafa:_average|0\": {\n \"acc_norm\": 0.3358629197371064,\n\
\ \"acc_norm_stderr\": 0.02165510188163109\n },\n \"community|arabic_mmlu:_average|0\"\
: {\n \"acc_norm\": 0.24980058752023732,\n \"acc_norm_stderr\": 0.03237548200690877\n\
\ }\n}\n```"
repo_url: https://huggingface.co/byroneverson/Yi-1.5-34B-Chat-abliterated
configs:
- config_name: community_acva_Algeria_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Algeria|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Algeria|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Ancient_Egypt_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Ancient_Egypt|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Ancient_Egypt|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arab_Empire_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arab_Empire|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arab_Empire|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Architecture_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Architecture|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Architecture|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Art_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Art|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Art|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Astronomy_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Astronomy|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Astronomy|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Calligraphy_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Calligraphy|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Calligraphy|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Ceremony_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Ceremony|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Ceremony|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Clothing_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Clothing|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Clothing|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Culture_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Culture|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Culture|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Food_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Food|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Food|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Funeral_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Funeral|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Funeral|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Geography_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Geography|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Geography|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_History_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_History|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_History|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Language_Origin_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Language_Origin|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Language_Origin|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Literature_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Literature|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Literature|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Math_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Math|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Math|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Medicine_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Medicine|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Medicine|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Music_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Music|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Music|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Ornament_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Ornament|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Ornament|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Philosophy_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Philosophy|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Philosophy|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Physics_and_Chemistry_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Physics_and_Chemistry|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Physics_and_Chemistry|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Arabic_Wedding_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Arabic_Wedding|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Arabic_Wedding|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Bahrain_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Bahrain|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Bahrain|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Comoros_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Comoros|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Comoros|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Egypt_modern_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Egypt_modern|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Egypt_modern|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_InfluenceFromAncientEgypt_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:InfluenceFromAncientEgypt|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromAncientEgypt|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_InfluenceFromByzantium_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:InfluenceFromByzantium|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromByzantium|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_InfluenceFromChina_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:InfluenceFromChina|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromChina|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_InfluenceFromGreece_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:InfluenceFromGreece|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromGreece|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_InfluenceFromIslam_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:InfluenceFromIslam|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromIslam|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_InfluenceFromPersia_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:InfluenceFromPersia|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromPersia|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_InfluenceFromRome_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:InfluenceFromRome|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:InfluenceFromRome|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Iraq_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Iraq|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Iraq|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Islam_Education_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Islam_Education|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Islam_Education|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Islam_branches_and_schools_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Islam_branches_and_schools|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Islam_branches_and_schools|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Islamic_law_system_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Islamic_law_system|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Islamic_law_system|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Jordan_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Jordan|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Jordan|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Kuwait_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Kuwait|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Kuwait|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Lebanon_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Lebanon|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Lebanon|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Libya_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Libya|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Libya|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Mauritania_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Mauritania|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Mauritania|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Mesopotamia_civilization_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Mesopotamia_civilization|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Mesopotamia_civilization|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Morocco_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Morocco|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Morocco|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Oman_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Oman|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Oman|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Palestine_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Palestine|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Palestine|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Qatar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Qatar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Qatar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Saudi_Arabia_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Saudi_Arabia|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Saudi_Arabia|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Somalia_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Somalia|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Somalia|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Sudan_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Sudan|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Sudan|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Syria_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Syria|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Syria|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Tunisia_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Tunisia|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Tunisia|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_United_Arab_Emirates_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:United_Arab_Emirates|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:United_Arab_Emirates|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_Yemen_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:Yemen|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:Yemen|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_communication_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:communication|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:communication|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_computer_and_phone_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:computer_and_phone|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:computer_and_phone|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_daily_life_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:daily_life|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:daily_life|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_acva_entertainment_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|acva:entertainment|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|acva:entertainment|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_mcq_exams_test_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:mcq_exams_test_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:mcq_exams_test_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_meta_ar_dialects_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:meta_ar_dialects|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:meta_ar_dialects|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_meta_ar_msa_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:meta_ar_msa|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:meta_ar_msa|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_multiple_choice_facts_truefalse_balanced_task_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:multiple_choice_facts_truefalse_balanced_task|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_facts_truefalse_balanced_task|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_multiple_choice_grounded_statement_soqal_task_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:multiple_choice_grounded_statement_soqal_task|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_grounded_statement_soqal_task|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_multiple_choice_rating_sentiment_no_neutral_task_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_multiple_choice_rating_sentiment_task_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:multiple_choice_rating_sentiment_task|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_rating_sentiment_task|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_alghafa_multiple_choice_sentiment_task_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|alghafa:multiple_choice_sentiment_task|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|alghafa:multiple_choice_sentiment_task|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_exams_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_exams|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_exams|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_abstract_algebra_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:abstract_algebra|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:abstract_algebra|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_anatomy_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:anatomy|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:anatomy|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_astronomy_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:astronomy|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:astronomy|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_business_ethics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:business_ethics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:business_ethics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_clinical_knowledge_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:clinical_knowledge|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:clinical_knowledge|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_college_biology_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:college_biology|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_biology|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_college_chemistry_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:college_chemistry|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_chemistry|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_college_computer_science_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:college_computer_science|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_computer_science|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_college_mathematics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:college_mathematics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_mathematics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_college_medicine_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:college_medicine|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_medicine|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_college_physics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:college_physics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:college_physics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_computer_security_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:computer_security|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:computer_security|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_conceptual_physics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:conceptual_physics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:conceptual_physics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_econometrics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:econometrics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:econometrics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_electrical_engineering_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:electrical_engineering|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:electrical_engineering|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_elementary_mathematics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:elementary_mathematics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:elementary_mathematics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_formal_logic_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:formal_logic|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:formal_logic|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_global_facts_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:global_facts|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:global_facts|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_biology_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_biology|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_biology|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_chemistry_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_chemistry|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_chemistry|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_computer_science_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_computer_science|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_computer_science|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_european_history_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_european_history|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_european_history|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_geography_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_geography|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_geography|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_government_and_politics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_government_and_politics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_government_and_politics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_macroeconomics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_macroeconomics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_macroeconomics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_mathematics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_mathematics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_mathematics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_microeconomics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_microeconomics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_microeconomics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_physics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_physics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_physics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_psychology_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_psychology|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_psychology|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_statistics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_statistics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_statistics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_us_history_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_us_history|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_us_history|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_high_school_world_history_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:high_school_world_history|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:high_school_world_history|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_human_aging_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:human_aging|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:human_aging|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_human_sexuality_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:human_sexuality|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:human_sexuality|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_international_law_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:international_law|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:international_law|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_jurisprudence_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:jurisprudence|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:jurisprudence|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_logical_fallacies_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:logical_fallacies|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:logical_fallacies|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_machine_learning_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:machine_learning|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:machine_learning|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_management_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:management|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:management|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_marketing_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:marketing|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:marketing|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_medical_genetics_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:medical_genetics|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:medical_genetics|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_miscellaneous_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:miscellaneous|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:miscellaneous|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_moral_disputes_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:moral_disputes|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:moral_disputes|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_moral_scenarios_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:moral_scenarios|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:moral_scenarios|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_nutrition_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:nutrition|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:nutrition|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_philosophy_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:philosophy|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:philosophy|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_prehistory_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:prehistory|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:prehistory|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_professional_accounting_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:professional_accounting|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:professional_accounting|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_professional_law_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:professional_law|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:professional_law|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_professional_medicine_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:professional_medicine|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:professional_medicine|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_professional_psychology_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:professional_psychology|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:professional_psychology|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_public_relations_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:public_relations|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:public_relations|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_security_studies_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:security_studies|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:security_studies|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_sociology_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:sociology|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:sociology|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_us_foreign_policy_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:us_foreign_policy|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:us_foreign_policy|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_virology_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:virology|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:virology|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arabic_mmlu_world_religions_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arabic_mmlu:world_religions|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arabic_mmlu:world_religions|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arc_challenge_okapi_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arc_challenge_okapi_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arc_challenge_okapi_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_arc_easy_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|arc_easy_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|arc_easy_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_boolq_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|boolq_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|boolq_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_copa_ext_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|copa_ext_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|copa_ext_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_hellaswag_okapi_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|hellaswag_okapi_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|hellaswag_okapi_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_openbook_qa_ext_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|openbook_qa_ext_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|openbook_qa_ext_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_piqa_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|piqa_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|piqa_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_race_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|race_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|race_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_sciq_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|sciq_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|sciq_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: community_toxigen_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_community|toxigen_ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_community|toxigen_ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: lighteval_xstory_cloze_ar_0_2025_01_23T08_24_12_065566_parquet
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- '**/details_lighteval|xstory_cloze:ar|0_2025-01-23T08-24-12.065566.parquet'
- split: latest
path:
- '**/details_lighteval|xstory_cloze:ar|0_2025-01-23T08-24-12.065566.parquet'
- config_name: results
data_files:
- split: 2025_01_23T08_24_12.065566
path:
- results_2025-01-23T08-24-12.065566.parquet
- split: latest
path:
- results_2025-01-23T08-24-12.065566.parquet
---
# Dataset Card for Evaluation run of byroneverson/Yi-1.5-34B-Chat-abliterated
<!-- Provide a quick summary of the dataset. -->
Dataset automatically created during the evaluation run of model [byroneverson/Yi-1.5-34B-Chat-abliterated](https://huggingface.co/byroneverson/Yi-1.5-34B-Chat-abliterated).
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional configuration "results" store all the aggregated results of the run.
To load the details from a run, you can for instance do the following:
```python
from datasets import load_dataset
data = load_dataset("OALL/details_byroneverson__Yi-1.5-34B-Chat-abliterated",
"lighteval_xstory_cloze_ar_0_2025_01_23T08_24_12_065566_parquet",
split="train")
Latest results
These are the latest results from run 2025-01-23T08:24:12.065566(note that their might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval):
{
"all": {
"acc_norm": 0.39277678347855827,
"acc_norm_stderr": 0.03715329375955906,
"acc": 0.4877564526803441,
"acc_stderr": 0.012863267059205548
},
"community|acva:Algeria|0": {
"acc_norm": 0.5076923076923077,
"acc_norm_stderr": 0.03589365940635213
},
"community|acva:Ancient_Egypt|0": {
"acc_norm": 0.7301587301587301,
"acc_norm_stderr": 0.025049438945858607
},
"community|acva:Arab_Empire|0": {
"acc_norm": 0.4716981132075472,
"acc_norm_stderr": 0.0307235352490061
},
"community|acva:Arabic_Architecture|0": {
"acc_norm": 0.5333333333333333,
"acc_norm_stderr": 0.03581804596782232
},
"community|acva:Arabic_Art|0": {
"acc_norm": 0.4717948717948718,
"acc_norm_stderr": 0.035840746749208334
},
"community|acva:Arabic_Astronomy|0": {
"acc_norm": 0.5076923076923077,
"acc_norm_stderr": 0.03589365940635213
},
"community|acva:Arabic_Calligraphy|0": {
"acc_norm": 0.6823529411764706,
"acc_norm_stderr": 0.02921191947723482
},
"community|acva:Arabic_Ceremony|0": {
"acc_norm": 0.5081081081081081,
"acc_norm_stderr": 0.036855642198496893
},
"community|acva:Arabic_Clothing|0": {
"acc_norm": 0.5076923076923077,
"acc_norm_stderr": 0.03589365940635213
},
"community|acva:Arabic_Culture|0": {
"acc_norm": 0.6102564102564103,
"acc_norm_stderr": 0.035014247762563705
},
"community|acva:Arabic_Food|0": {
"acc_norm": 0.38974358974358975,
"acc_norm_stderr": 0.03501424776256371
},
"community|acva:Arabic_Funeral|0": {
"acc_norm": 0.6105263157894737,
"acc_norm_stderr": 0.05029529117145396
},
"community|acva:Arabic_Geography|0": {
"acc_norm": 0.6,
"acc_norm_stderr": 0.04082482904638628
},
"community|acva:Arabic_History|0": {
"acc_norm": 0.4256410256410256,
"acc_norm_stderr": 0.035498710803677086
},
"community|acva:Arabic_Language_Origin|0": {
"acc_norm": 0.5894736842105263,
"acc_norm_stderr": 0.05073863564551209
},
"community|acva:Arabic_Literature|0": {
"acc_norm": 0.5862068965517241,
"acc_norm_stderr": 0.041042692118062316
},
"community|acva:Arabic_Math|0": {
"acc_norm": 0.5333333333333333,
"acc_norm_stderr": 0.03581804596782233
},
"community|acva:Arabic_Medicine|0": {
"acc_norm": 0.6413793103448275,
"acc_norm_stderr": 0.039966295748767186
},
"community|acva:Arabic_Music|0": {
"acc_norm": 0.539568345323741,
"acc_norm_stderr": 0.04242933990068981
},
"community|acva:Arabic_Ornament|0": {
"acc_norm": 0.4717948717948718,
"acc_norm_stderr": 0.035840746749208334
},
"community|acva:Arabic_Philosophy|0": {
"acc_norm": 0.4896551724137931,
"acc_norm_stderr": 0.04165774775728763
},
"community|acva:Arabic_Physics_and_Chemistry|0": {
"acc_norm": 0.48717948717948717,
"acc_norm_stderr": 0.035886105231922164
},
"community|acva:Arabic_Wedding|0": {
"acc_norm": 0.558974358974359,
"acc_norm_stderr": 0.0356473293185358
},
"community|acva:Bahrain|0": {
"acc_norm": 0.6,
"acc_norm_stderr": 0.07385489458759965
},
"community|acva:Comoros|0": {
"acc_norm": 0.5777777777777777,
"acc_norm_stderr": 0.07446027270295805
},
"community|acva:Egypt_modern|0": {
"acc_norm": 0.4105263157894737,
"acc_norm_stderr": 0.050738635645512106
},
"community|acva:InfluenceFromAncientEgypt|0": {
"acc_norm": 0.5384615384615384,
"acc_norm_stderr": 0.035791543525445724
},
"community|acva:InfluenceFromByzantium|0": {
"acc_norm": 0.7379310344827587,
"acc_norm_stderr": 0.036646663372252565
},
"community|acva:InfluenceFromChina|0": {
"acc_norm": 0.38974358974358975,
"acc_norm_stderr": 0.03501424776256371
},
"community|acva:InfluenceFromGreece|0": {
"acc_norm": 0.6358974358974359,
"acc_norm_stderr": 0.034546538677863885
},
"community|acva:InfluenceFromIslam|0": {
"acc_norm": 0.7448275862068966,
"acc_norm_stderr": 0.03632984052707842
},
"community|acva:InfluenceFromPersia|0": {
"acc_norm": 0.7828571428571428,
"acc_norm_stderr": 0.031256432600906624
},
"community|acva:InfluenceFromRome|0": {
"acc_norm": 0.6102564102564103,
"acc_norm_stderr": 0.03501424776256371
},
"community|acva:Iraq|0": {
"acc_norm": 0.5058823529411764,
"acc_norm_stderr": 0.05455069703232772
},
"community|acva:Islam_Education|0": {
"acc_norm": 0.517948717948718,
"acc_norm_stderr": 0.03587477098773825
},
"community|acva:Islam_branches_and_schools|0": {
"acc_norm": 0.5085714285714286,
"acc_norm_stderr": 0.0378993320697706
},
"community|acva:Islamic_law_system|0": {
"acc_norm": 0.5282051282051282,
"acc_norm_stderr": 0.035840746749208334
},
"community|acva:Jordan|0": {
"acc_norm": 0.4444444444444444,
"acc_norm_stderr": 0.07491109582924917
},
"community|acva:Kuwait|0": {
"acc_norm": 0.6222222222222222,
"acc_norm_stderr": 0.07309112127323451
},
"community|acva:Lebanon|0": {
"acc_norm": 0.4222222222222222,
"acc_norm_stderr": 0.07446027270295805
},
"community|acva:Libya|0": {
"acc_norm": 0.5555555555555556,
"acc_norm_stderr": 0.07491109582924914
},
"community|acva:Mauritania|0": {
"acc_norm": 0.37777777777777777,
"acc_norm_stderr": 0.0730911212732345
},
"community|acva:Mesopotamia_civilization|0": {
"acc_norm": 0.4838709677419355,
"acc_norm_stderr": 0.040270179608539264
},
"community|acva:Morocco|0": {
"acc_norm": 0.6222222222222222,
"acc_norm_stderr": 0.07309112127323451
},
"community|acva:Oman|0": {
"acc_norm": 0.3333333333333333,
"acc_norm_stderr": 0.07106690545187012
},
"community|acva:Palestine|0": {
"acc_norm": 0.4470588235294118,
"acc_norm_stderr": 0.054247803536170265
},
"community|acva:Qatar|0": {
"acc_norm": 0.5777777777777777,
"acc_norm_stderr": 0.07446027270295805
},
"community|acva:Saudi_Arabia|0": {
"acc_norm": 0.5384615384615384,
"acc_norm_stderr": 0.0357915435254457
},
"community|acva:Somalia|0": {
"acc_norm": 0.6666666666666666,
"acc_norm_stderr": 0.07106690545187012
},
"community|acva:Sudan|0": {
"acc_norm": 0.4444444444444444,
"acc_norm_stderr": 0.07491109582924915
},
"community|acva:Syria|0": {
"acc_norm": 0.5333333333333333,
"acc_norm_stderr": 0.0752101433090355
},
"community|acva:Tunisia|0": {
"acc_norm": 0.6,
"acc_norm_stderr": 0.07385489458759965
},
"community|acva:United_Arab_Emirates|0": {
"acc_norm": 0.5294117647058824,
"acc_norm_stderr": 0.0544600058689736
},
"community|acva:Yemen|0": {
"acc_norm": 0.4,
"acc_norm_stderr": 0.1632993161855452
},
"community|acva:communication|0": {
"acc_norm": 0.5879120879120879,
"acc_norm_stderr": 0.0258343667152563
},
"community|acva:computer_and_phone|0": {
"acc_norm": 0.5016949152542373,
"acc_norm_stderr": 0.029160424634042836
},
"community|acva:daily_life|0": {
"acc_norm": 0.8011869436201781,
"acc_norm_stderr": 0.021773073762099047
},
"community|acva:entertainment|0": {
"acc_norm": 0.7559322033898305,
"acc_norm_stderr": 0.025050880690319716
},
"community|alghafa:mcq_exams_test_ar|0": {
"acc_norm": 0.24057450628366248,
"acc_norm_stderr": 0.018127169342271113
},
"community|alghafa:meta_ar_dialects|0": {
"acc_norm": 0.23892493049119556,
"acc_norm_stderr": 0.00580616015547375
},
"community|alghafa:meta_ar_msa|0": {
"acc_norm": 0.25251396648044694,
"acc_norm_stderr": 0.014530330201468659
},
"community|alghafa:multiple_choice_facts_truefalse_balanced_task|0": {
"acc_norm": 0.5333333333333333,
"acc_norm_stderr": 0.05799451149344531
},
"community|alghafa:multiple_choice_grounded_statement_soqal_task|0": {
"acc_norm": 0.32666666666666666,
"acc_norm_stderr": 0.03842150156165228
},
"community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0": {
"acc_norm": 0.2866666666666667,
"acc_norm_stderr": 0.03704603420423024
},
"community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0": {
"acc_norm": 0.4858036272670419,
"acc_norm_stderr": 0.005590012885334055
},
"community|alghafa:multiple_choice_rating_sentiment_task|0": {
"acc_norm": 0.33444537114261885,
"acc_norm_stderr": 0.006093910612833501
},
"community|alghafa:multiple_choice_sentiment_task|0": {
"acc_norm": 0.32383720930232557,
"acc_norm_stderr": 0.011286286477970866
},
"community|arabic_exams|0": {
"acc_norm": 0.24767225325884543,
"acc_norm_stderr": 0.018644889871740993
},
"community|arabic_mmlu:abstract_algebra|0": {
"acc_norm": 0.29,
"acc_norm_stderr": 0.045604802157206845
},
"community|arabic_mmlu:anatomy|0": {
"acc_norm": 0.22962962962962963,
"acc_norm_stderr": 0.036333844140734636
},
"community|arabic_mmlu:astronomy|0": {
"acc_norm": 0.23684210526315788,
"acc_norm_stderr": 0.03459777606810537
},
"community|arabic_mmlu:business_ethics|0": {
"acc_norm": 0.29,
"acc_norm_stderr": 0.04560480215720683
},
"community|arabic_mmlu:clinical_knowledge|0": {
"acc_norm": 0.2188679245283019,
"acc_norm_stderr": 0.025447863825108618
},
"community|arabic_mmlu:college_biology|0": {
"acc_norm": 0.3125,
"acc_norm_stderr": 0.038760854559127644
},
"community|arabic_mmlu:college_chemistry|0": {
"acc_norm": 0.23,
"acc_norm_stderr": 0.04229525846816508
},
"community|arabic_mmlu:college_computer_science|0": {
"acc_norm": 0.34,
"acc_norm_stderr": 0.04760952285695235
},
"community|arabic_mmlu:college_mathematics|0": {
"acc_norm": 0.3,
"acc_norm_stderr": 0.046056618647183814
},
"community|arabic_mmlu:college_medicine|0": {
"acc_norm": 0.1791907514450867,
"acc_norm_stderr": 0.029242513059063308
},
"community|arabic_mmlu:college_physics|0": {
"acc_norm": 0.20588235294117646,
"acc_norm_stderr": 0.04023382273617747
},
"community|arabic_mmlu:computer_security|0": {
"acc_norm": 0.27,
"acc_norm_stderr": 0.0446196043338474
},
"community|arabic_mmlu:conceptual_physics|0": {
"acc_norm": 0.3276595744680851,
"acc_norm_stderr": 0.030683020843231004
},
"community|arabic_mmlu:econometrics|0": {
"acc_norm": 0.2543859649122807,
"acc_norm_stderr": 0.040969851398436695
},
"community|arabic_mmlu:electrical_engineering|0": {
"acc_norm": 0.21379310344827587,
"acc_norm_stderr": 0.034165204477475494
},
"community|arabic_mmlu:elementary_mathematics|0": {
"acc_norm": 0.2698412698412698,
"acc_norm_stderr": 0.022860838309232072
},
"community|arabic_mmlu:formal_logic|0": {
"acc_norm": 0.2619047619047619,
"acc_norm_stderr": 0.039325376803928724
},
"community|arabic_mmlu:global_facts|0": {
"acc_norm": 0.31,
"acc_norm_stderr": 0.04648231987117316
},
"community|arabic_mmlu:high_school_biology|0": {
"acc_norm": 0.2032258064516129,
"acc_norm_stderr": 0.02289168798455496
},
"community|arabic_mmlu:high_school_chemistry|0": {
"acc_norm": 0.17733990147783252,
"acc_norm_stderr": 0.026874337276808352
},
"community|arabic_mmlu:high_school_computer_science|0": {
"acc_norm": 0.32,
"acc_norm_stderr": 0.04688261722621503
},
"community|arabic_mmlu:high_school_european_history|0": {
"acc_norm": 0.22424242424242424,
"acc_norm_stderr": 0.032568666616811015
},
"community|arabic_mmlu:high_school_geography|0": {
"acc_norm": 0.23232323232323232,
"acc_norm_stderr": 0.03008862949021749
},
"community|arabic_mmlu:high_school_government_and_politics|0": {
"acc_norm": 0.19170984455958548,
"acc_norm_stderr": 0.028408953626245296
},
"community|arabic_mmlu:high_school_macroeconomics|0": {
"acc_norm": 0.18974358974358974,
"acc_norm_stderr": 0.019880165406588778
},
"community|arabic_mmlu:high_school_mathematics|0": {
"acc_norm": 0.21851851851851853,
"acc_norm_stderr": 0.025195752251823782
},
"community|arabic_mmlu:high_school_microeconomics|0": {
"acc_norm": 0.226890756302521,
"acc_norm_stderr": 0.02720537153827948
},
"community|arabic_mmlu:high_school_physics|0": {
"acc_norm": 0.2980132450331126,
"acc_norm_stderr": 0.037345356767871984
},
"community|arabic_mmlu:high_school_psychology|0": {
"acc_norm": 0.20550458715596331,
"acc_norm_stderr": 0.01732435232501601
},
"community|arabic_mmlu:high_school_statistics|0": {
"acc_norm": 0.18055555555555555,
"acc_norm_stderr": 0.026232878971491652
},
"community|arabic_mmlu:high_school_us_history|0": {
"acc_norm": 0.24509803921568626,
"acc_norm_stderr": 0.03019028245350195
},
"community|arabic_mmlu:high_school_world_history|0": {
"acc_norm": 0.25738396624472576,
"acc_norm_stderr": 0.02845882099146029
},
"community|arabic_mmlu:human_aging|0": {
"acc_norm": 0.3004484304932735,
"acc_norm_stderr": 0.03076935200822914
},
"community|arabic_mmlu:human_sexuality|0": {
"acc_norm": 0.31297709923664124,
"acc_norm_stderr": 0.04066962905677697
},
"community|arabic_mmlu:international_law|0": {
"acc_norm": 0.23140495867768596,
"acc_norm_stderr": 0.03849856098794088
},
"community|arabic_mmlu:jurisprudence|0": {
"acc_norm": 0.25925925925925924,
"acc_norm_stderr": 0.042365112580946336
},
"community|arabic_mmlu:logical_fallacies|0": {
"acc_norm": 0.19631901840490798,
"acc_norm_stderr": 0.031207970394709215
},
"community|arabic_mmlu:machine_learning|0": {
"acc_norm": 0.25,
"acc_norm_stderr": 0.04109974682633932
},
"community|arabic_mmlu:management|0": {
"acc_norm": 0.1941747572815534,
"acc_norm_stderr": 0.039166677628225836
},
"community|arabic_mmlu:marketing|0": {
"acc_norm": 0.29914529914529914,
"acc_norm_stderr": 0.029996951858349497
},
"community|arabic_mmlu:medical_genetics|0": {
"acc_norm": 0.31,
"acc_norm_stderr": 0.04648231987117316
},
"community|arabic_mmlu:miscellaneous|0": {
"acc_norm": 0.24904214559386972,
"acc_norm_stderr": 0.015464676163395965
},
"community|arabic_mmlu:moral_disputes|0": {
"acc_norm": 0.2543352601156069,
"acc_norm_stderr": 0.02344582627654555
},
"community|arabic_mmlu:moral_scenarios|0": {
"acc_norm": 0.26145251396648045,
"acc_norm_stderr": 0.014696599650364555
},
"community|arabic_mmlu:nutrition|0": {
"acc_norm": 0.26143790849673204,
"acc_norm_stderr": 0.025160998214292456
},
"community|arabic_mmlu:philosophy|0": {
"acc_norm": 0.2057877813504823,
"acc_norm_stderr": 0.022961339906764237
},
"community|arabic_mmlu:prehistory|0": {
"acc_norm": 0.2716049382716049,
"acc_norm_stderr": 0.02474862449053738
},
"community|arabic_mmlu:professional_accounting|0": {
"acc_norm": 0.23404255319148937,
"acc_norm_stderr": 0.025257861359432414
},
"community|arabic_mmlu:professional_law|0": {
"acc_norm": 0.24967405475880053,
"acc_norm_stderr": 0.011054538377832322
},
"community|arabic_mmlu:professional_medicine|0": {
"acc_norm": 0.20220588235294118,
"acc_norm_stderr": 0.024398192986654924
},
"community|arabic_mmlu:professional_psychology|0": {
"acc_norm": 0.25,
"acc_norm_stderr": 0.01751781884501444
},
"community|arabic_mmlu:public_relations|0": {
"acc_norm": 0.18181818181818182,
"acc_norm_stderr": 0.036942843353378024
},
"community|arabic_mmlu:security_studies|0": {
"acc_norm": 0.20408163265306123,
"acc_norm_stderr": 0.025801283475090503
},
"community|arabic_mmlu:sociology|0": {
"acc_norm": 0.24378109452736318,
"acc_norm_stderr": 0.030360490154014645
},
"community|arabic_mmlu:us_foreign_policy|0": {
"acc_norm": 0.3,
"acc_norm_stderr": 0.046056618647183814
},
"community|arabic_mmlu:virology|0": {
"acc_norm": 0.27710843373493976,
"acc_norm_stderr": 0.03484331592680588
},
"community|arabic_mmlu:world_religions|0": {
"acc_norm": 0.32748538011695905,
"acc_norm_stderr": 0.035993357714560276
},
"community|arc_challenge_okapi_ar|0": {
"acc_norm": 0.2681034482758621,
"acc_norm_stderr": 0.013011708714624957
},
"community|arc_easy_ar|0": {
"acc_norm": 0.2521150592216582,
"acc_norm_stderr": 0.008932744808153058
},
"community|boolq_ar|0": {
"acc_norm": 0.6168711656441718,
"acc_norm_stderr": 0.008515839629223856
},
"community|copa_ext_ar|0": {
"acc_norm": 0.4777777777777778,
"acc_norm_stderr": 0.05294752255076824
},
"community|hellaswag_okapi_ar|0": {
"acc_norm": 0.25264420455784536,
"acc_norm_stderr": 0.004537678325622731
},
"community|openbook_qa_ext_ar|0": {
"acc_norm": 0.3212121212121212,
"acc_norm_stderr": 0.021008716833566338
},
"community|piqa_ar|0": {
"acc_norm": 0.508456082924168,
"acc_norm_stderr": 0.011680062105905479
},
"community|race_ar|0": {
"acc_norm": 0.26820856157435585,
"acc_norm_stderr": 0.0063109484249868585
},
"community|sciq_ar|0": {
"acc_norm": 0.32964824120603015,
"acc_norm_stderr": 0.014910203327095755
},
"community|toxigen_ar|0": {
"acc_norm": 0.4320855614973262,
"acc_norm_stderr": 0.01620887578524445
},
"lighteval|xstory_cloze:ar|0": {
"acc": 0.4877564526803441,
"acc_stderr": 0.012863267059205548
},
"community|acva:_average|0": {
"acc_norm": 0.548080543554616,
"acc_norm_stderr": 0.04825322544543206
},
"community|alghafa:_average|0": {
"acc_norm": 0.3358629197371064,
"acc_norm_stderr": 0.02165510188163109
},
"community|arabic_mmlu:_average|0": {
"acc_norm": 0.24980058752023732,
"acc_norm_stderr": 0.03237548200690877
}
}
Dataset Details
Dataset Description
- Curated by: [More Information Needed]
- Funded by [optional]: [More Information Needed]
- Shared by [optional]: [More Information Needed]
- Language(s) (NLP): [More Information Needed]
- License: [More Information Needed]
Dataset Sources [optional]
- Repository: [More Information Needed]
- Paper [optional]: [More Information Needed]
- Demo [optional]: [More Information Needed]
Uses
Direct Use
[More Information Needed]
Out-of-Scope Use
[More Information Needed]
Dataset Structure
[More Information Needed]
Dataset Creation
Curation Rationale
[More Information Needed]
Source Data
Data Collection and Processing
[More Information Needed]
Who are the source data producers?
[More Information Needed]
Annotations [optional]
Annotation process
[More Information Needed]
Who are the annotators?
[More Information Needed]
Personal and Sensitive Information
[More Information Needed]
Bias, Risks, and Limitations
[More Information Needed]
Recommendations
Users should be made aware of the risks, biases and limitations of the dataset. More information needed for further recommendations.
Citation [optional]
BibTeX:
[More Information Needed]
APA:
[More Information Needed]
Glossary [optional]
[More Information Needed]
More Information [optional]
[More Information Needed]
Dataset Card Authors [optional]
[More Information Needed]
Dataset Card Contact
[More Information Needed]