size_categories:100K<n<1M format:parquet modality:tabular modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
pretty_name: Evaluation run of RDson/CoderO1-DeepSeekR1-Coder-32B-Preview
dataset_summary: "Dataset automatically created during the evaluation run of model\
  \ [RDson/CoderO1-DeepSeekR1-Coder-32B-Preview](https://huggingface.co/RDson/CoderO1-DeepSeekR1-Coder-32B-Preview).\n\
  \nThe dataset is composed of 136 configuration, each one coresponding to one of\
  \ the evaluated task.\n\nThe dataset has been created from 1 run(s). Each run can\
  \ be found as a specific split in each configuration, the split being named using\
  \ the timestamp of the run.The \"train\" split is always pointing to the latest\
  \ results.\n\nAn additional configuration \"results\" store all the aggregated results\
  \ of the run.\n\nTo load the details from a run, you can for instance do the following:\n\
  ```python\nfrom datasets import load_dataset\ndata = load_dataset(\"OALL/details_RDson__CoderO1-DeepSeekR1-Coder-32B-Preview\"\
  ,\n\t\"lighteval_xstory_cloze_ar_0_2025_02_06T15_40_51_477476_parquet\",\n\tsplit=\"\
  train\")\n```\n\n## Latest results\n\nThese are the [latest results from run 2025-02-06T15:40:51.477476](https://huggingface.co/datasets/OALL/details_RDson__CoderO1-DeepSeekR1-Coder-32B-Preview/blob/main/results_2025-02-06T15-40-51.477476.json)(note\
  \ that their might be results for other tasks in the repos if successive evals didn't\
  \ cover the same tasks. You find each in the results and the \"latest\" split for\
  \ each eval):\n\n```python\n{\n    \"all\": {\n        \"acc_norm\": 0.4650750505619803,\n\
  \        \"acc_norm_stderr\": 0.037939728859166695,\n        \"acc\": 0.6406353408338848,\n\
  \        \"acc_stderr\": 0.01234765980210167\n    },\n    \"community|acva:Algeria|0\"\
  : {\n        \"acc_norm\": 0.5230769230769231,\n        \"acc_norm_stderr\": 0.0358596530894741\n\
  \    },\n    \"community|acva:Ancient_Egypt|0\": {\n        \"acc_norm\": 0.050793650793650794,\n\
  \        \"acc_norm_stderr\": 0.01239139518482262\n    },\n    \"community|acva:Arab_Empire|0\"\
  : {\n        \"acc_norm\": 0.30943396226415093,\n        \"acc_norm_stderr\": 0.028450154794118627\n\
  \    },\n    \"community|acva:Arabic_Architecture|0\": {\n        \"acc_norm\":\
  \ 0.4564102564102564,\n        \"acc_norm_stderr\": 0.035761230969912135\n    },\n\
  \    \"community|acva:Arabic_Art|0\": {\n        \"acc_norm\": 0.3641025641025641,\n\
  \        \"acc_norm_stderr\": 0.03454653867786389\n    },\n    \"community|acva:Arabic_Astronomy|0\"\
  : {\n        \"acc_norm\": 0.4666666666666667,\n        \"acc_norm_stderr\": 0.03581804596782233\n\
  \    },\n    \"community|acva:Arabic_Calligraphy|0\": {\n        \"acc_norm\": 0.47843137254901963,\n\
  \        \"acc_norm_stderr\": 0.0313435870640056\n    },\n    \"community|acva:Arabic_Ceremony|0\"\
  : {\n        \"acc_norm\": 0.518918918918919,\n        \"acc_norm_stderr\": 0.036834092970087065\n\
  \    },\n    \"community|acva:Arabic_Clothing|0\": {\n        \"acc_norm\": 0.5128205128205128,\n\
  \        \"acc_norm_stderr\": 0.03588610523192215\n    },\n    \"community|acva:Arabic_Culture|0\"\
  : {\n        \"acc_norm\": 0.23076923076923078,\n        \"acc_norm_stderr\": 0.0302493752938313\n\
  \    },\n    \"community|acva:Arabic_Food|0\": {\n        \"acc_norm\": 0.441025641025641,\n\
  \        \"acc_norm_stderr\": 0.0356473293185358\n    },\n    \"community|acva:Arabic_Funeral|0\"\
  : {\n        \"acc_norm\": 0.4,\n        \"acc_norm_stderr\": 0.050529115263991134\n\
  \    },\n    \"community|acva:Arabic_Geography|0\": {\n        \"acc_norm\": 0.6068965517241379,\n\
  \        \"acc_norm_stderr\": 0.040703290137070705\n    },\n    \"community|acva:Arabic_History|0\"\
  : {\n        \"acc_norm\": 0.30256410256410254,\n        \"acc_norm_stderr\": 0.03298070870085619\n\
  \    },\n    \"community|acva:Arabic_Language_Origin|0\": {\n        \"acc_norm\"\
  : 0.5473684210526316,\n        \"acc_norm_stderr\": 0.051339113773544845\n    },\n\
  \    \"community|acva:Arabic_Literature|0\": {\n        \"acc_norm\": 0.47586206896551725,\n\
  \        \"acc_norm_stderr\": 0.041618085035015295\n    },\n    \"community|acva:Arabic_Math|0\"\
  : {\n        \"acc_norm\": 0.30256410256410254,\n        \"acc_norm_stderr\": 0.03298070870085618\n\
  \    },\n    \"community|acva:Arabic_Medicine|0\": {\n        \"acc_norm\": 0.46206896551724136,\n\
  \        \"acc_norm_stderr\": 0.041546596717075474\n    },\n    \"community|acva:Arabic_Music|0\"\
  : {\n        \"acc_norm\": 0.23741007194244604,\n        \"acc_norm_stderr\": 0.036220593237998276\n\
  \    },\n    \"community|acva:Arabic_Ornament|0\": {\n        \"acc_norm\": 0.4717948717948718,\n\
  \        \"acc_norm_stderr\": 0.035840746749208334\n    },\n    \"community|acva:Arabic_Philosophy|0\"\
  : {\n        \"acc_norm\": 0.5793103448275863,\n        \"acc_norm_stderr\": 0.0411391498118926\n\
  \    },\n    \"community|acva:Arabic_Physics_and_Chemistry|0\": {\n        \"acc_norm\"\
  : 0.5333333333333333,\n        \"acc_norm_stderr\": 0.03581804596782232\n    },\n\
  \    \"community|acva:Arabic_Wedding|0\": {\n        \"acc_norm\": 0.41025641025641024,\n\
  \        \"acc_norm_stderr\": 0.03531493712326671\n    },\n    \"community|acva:Bahrain|0\"\
  : {\n        \"acc_norm\": 0.3111111111111111,\n        \"acc_norm_stderr\": 0.06979205927323111\n\
  \    },\n    \"community|acva:Comoros|0\": {\n        \"acc_norm\": 0.37777777777777777,\n\
  \        \"acc_norm_stderr\": 0.07309112127323451\n    },\n    \"community|acva:Egypt_modern|0\"\
  : {\n        \"acc_norm\": 0.3157894736842105,\n        \"acc_norm_stderr\": 0.04794350420740798\n\
  \    },\n    \"community|acva:InfluenceFromAncientEgypt|0\": {\n        \"acc_norm\"\
  : 0.6051282051282051,\n        \"acc_norm_stderr\": 0.03509545602262038\n    },\n\
  \    \"community|acva:InfluenceFromByzantium|0\": {\n        \"acc_norm\": 0.7172413793103448,\n\
  \        \"acc_norm_stderr\": 0.03752833958003337\n    },\n    \"community|acva:InfluenceFromChina|0\"\
  : {\n        \"acc_norm\": 0.26666666666666666,\n        \"acc_norm_stderr\": 0.0317493043641267\n\
  \    },\n    \"community|acva:InfluenceFromGreece|0\": {\n        \"acc_norm\":\
  \ 0.6307692307692307,\n        \"acc_norm_stderr\": 0.034648411418637566\n    },\n\
  \    \"community|acva:InfluenceFromIslam|0\": {\n        \"acc_norm\": 0.296551724137931,\n\
  \        \"acc_norm_stderr\": 0.03806142687309993\n    },\n    \"community|acva:InfluenceFromPersia|0\"\
  : {\n        \"acc_norm\": 0.6971428571428572,\n        \"acc_norm_stderr\": 0.03483414676585986\n\
  \    },\n    \"community|acva:InfluenceFromRome|0\": {\n        \"acc_norm\": 0.5743589743589743,\n\
  \        \"acc_norm_stderr\": 0.03549871080367708\n    },\n    \"community|acva:Iraq|0\"\
  : {\n        \"acc_norm\": 0.5058823529411764,\n        \"acc_norm_stderr\": 0.05455069703232772\n\
  \    },\n    \"community|acva:Islam_Education|0\": {\n        \"acc_norm\": 0.4512820512820513,\n\
  \        \"acc_norm_stderr\": 0.03572709860318392\n    },\n    \"community|acva:Islam_branches_and_schools|0\"\
  : {\n        \"acc_norm\": 0.4342857142857143,\n        \"acc_norm_stderr\": 0.037576101528126626\n\
  \    },\n    \"community|acva:Islamic_law_system|0\": {\n        \"acc_norm\": 0.4256410256410256,\n\
  \        \"acc_norm_stderr\": 0.035498710803677086\n    },\n    \"community|acva:Jordan|0\"\
  : {\n        \"acc_norm\": 0.35555555555555557,\n        \"acc_norm_stderr\": 0.07216392363431012\n\
  \    },\n    \"community|acva:Kuwait|0\": {\n        \"acc_norm\": 0.26666666666666666,\n\
  \        \"acc_norm_stderr\": 0.06666666666666667\n    },\n    \"community|acva:Lebanon|0\"\
  : {\n        \"acc_norm\": 0.17777777777777778,\n        \"acc_norm_stderr\": 0.05763774795025094\n\
  \    },\n    \"community|acva:Libya|0\": {\n        \"acc_norm\": 0.4444444444444444,\n\
  \        \"acc_norm_stderr\": 0.07491109582924914\n    },\n    \"community|acva:Mauritania|0\"\
  : {\n        \"acc_norm\": 0.4222222222222222,\n        \"acc_norm_stderr\": 0.07446027270295805\n\
  \    },\n    \"community|acva:Mesopotamia_civilization|0\": {\n        \"acc_norm\"\
  : 0.5225806451612903,\n        \"acc_norm_stderr\": 0.0402500394824441\n    },\n\
  \    \"community|acva:Morocco|0\": {\n        \"acc_norm\": 0.2222222222222222,\n\
  \        \"acc_norm_stderr\": 0.06267511942419628\n    },\n    \"community|acva:Oman|0\"\
  : {\n        \"acc_norm\": 0.17777777777777778,\n        \"acc_norm_stderr\": 0.05763774795025094\n\
  \    },\n    \"community|acva:Palestine|0\": {\n        \"acc_norm\": 0.24705882352941178,\n\
  \        \"acc_norm_stderr\": 0.047058823529411785\n    },\n    \"community|acva:Qatar|0\"\
  : {\n        \"acc_norm\": 0.4,\n        \"acc_norm_stderr\": 0.07385489458759964\n\
  \    },\n    \"community|acva:Saudi_Arabia|0\": {\n        \"acc_norm\": 0.3435897435897436,\n\
  \        \"acc_norm_stderr\": 0.03409627301409855\n    },\n    \"community|acva:Somalia|0\"\
  : {\n        \"acc_norm\": 0.35555555555555557,\n        \"acc_norm_stderr\": 0.07216392363431012\n\
  \    },\n    \"community|acva:Sudan|0\": {\n        \"acc_norm\": 0.35555555555555557,\n\
  \        \"acc_norm_stderr\": 0.07216392363431012\n    },\n    \"community|acva:Syria|0\"\
  : {\n        \"acc_norm\": 0.3333333333333333,\n        \"acc_norm_stderr\": 0.07106690545187012\n\
  \    },\n    \"community|acva:Tunisia|0\": {\n        \"acc_norm\": 0.3111111111111111,\n\
  \        \"acc_norm_stderr\": 0.06979205927323111\n    },\n    \"community|acva:United_Arab_Emirates|0\"\
  : {\n        \"acc_norm\": 0.23529411764705882,\n        \"acc_norm_stderr\": 0.04628210543937907\n\
  \    },\n    \"community|acva:Yemen|0\": {\n        \"acc_norm\": 0.2,\n       \
  \ \"acc_norm_stderr\": 0.13333333333333333\n    },\n    \"community|acva:communication|0\"\
  : {\n        \"acc_norm\": 0.42857142857142855,\n        \"acc_norm_stderr\": 0.025974025974025955\n\
  \    },\n    \"community|acva:computer_and_phone|0\": {\n        \"acc_norm\": 0.45084745762711864,\n\
  \        \"acc_norm_stderr\": 0.02901934773187137\n    },\n    \"community|acva:daily_life|0\"\
  : {\n        \"acc_norm\": 0.18694362017804153,\n        \"acc_norm_stderr\": 0.021268948348414647\n\
  \    },\n    \"community|acva:entertainment|0\": {\n        \"acc_norm\": 0.23389830508474577,\n\
  \        \"acc_norm_stderr\": 0.024687839412166384\n    },\n    \"community|alghafa:mcq_exams_test_ar|0\"\
  : {\n        \"acc_norm\": 0.36983842010771995,\n        \"acc_norm_stderr\": 0.020473617130765447\n\
  \    },\n    \"community|alghafa:meta_ar_dialects|0\": {\n        \"acc_norm\":\
  \ 0.38591288229842446,\n        \"acc_norm_stderr\": 0.006628330583807984\n    },\n\
  \    \"community|alghafa:meta_ar_msa|0\": {\n        \"acc_norm\": 0.4201117318435754,\n\
  \        \"acc_norm_stderr\": 0.016507671073256402\n    },\n    \"community|alghafa:multiple_choice_facts_truefalse_balanced_task|0\"\
  : {\n        \"acc_norm\": 0.52,\n        \"acc_norm_stderr\": 0.05807730170189531\n\
  \    },\n    \"community|alghafa:multiple_choice_grounded_statement_soqal_task|0\"\
  : {\n        \"acc_norm\": 0.5866666666666667,\n        \"acc_norm_stderr\": 0.040341569222180455\n\
  \    },\n    \"community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0\"\
  : {\n        \"acc_norm\": 0.46,\n        \"acc_norm_stderr\": 0.04083030852148599\n\
  \    },\n    \"community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0\"\
  : {\n        \"acc_norm\": 0.7892432770481551,\n        \"acc_norm_stderr\": 0.004561567357594509\n\
  \    },\n    \"community|alghafa:multiple_choice_rating_sentiment_task|0\": {\n\
  \        \"acc_norm\": 0.5459549624687239,\n        \"acc_norm_stderr\": 0.006430866682158502\n\
  \    },\n    \"community|alghafa:multiple_choice_sentiment_task|0\": {\n       \
  \ \"acc_norm\": 0.3988372093023256,\n        \"acc_norm_stderr\": 0.01181016436883932\n\
  \    },\n    \"community|arabic_exams|0\": {\n        \"acc_norm\": 0.5139664804469274,\n\
  \        \"acc_norm_stderr\": 0.021588283575384216\n    },\n    \"community|arabic_mmlu:abstract_algebra|0\"\
  : {\n        \"acc_norm\": 0.37,\n        \"acc_norm_stderr\": 0.04852365870939099\n\
  \    },\n    \"community|arabic_mmlu:anatomy|0\": {\n        \"acc_norm\": 0.3851851851851852,\n\
  \        \"acc_norm_stderr\": 0.042039210401562783\n    },\n    \"community|arabic_mmlu:astronomy|0\"\
  : {\n        \"acc_norm\": 0.6381578947368421,\n        \"acc_norm_stderr\": 0.03910525752849724\n\
  \    },\n    \"community|arabic_mmlu:business_ethics|0\": {\n        \"acc_norm\"\
  : 0.58,\n        \"acc_norm_stderr\": 0.049604496374885836\n    },\n    \"community|arabic_mmlu:clinical_knowledge|0\"\
  : {\n        \"acc_norm\": 0.5283018867924528,\n        \"acc_norm_stderr\": 0.0307235352490061\n\
  \    },\n    \"community|arabic_mmlu:college_biology|0\": {\n        \"acc_norm\"\
  : 0.5347222222222222,\n        \"acc_norm_stderr\": 0.04171115858181618\n    },\n\
  \    \"community|arabic_mmlu:college_chemistry|0\": {\n        \"acc_norm\": 0.47,\n\
  \        \"acc_norm_stderr\": 0.050161355804659205\n    },\n    \"community|arabic_mmlu:college_computer_science|0\"\
  : {\n        \"acc_norm\": 0.46,\n        \"acc_norm_stderr\": 0.05009082659620333\n\
  \    },\n    \"community|arabic_mmlu:college_mathematics|0\": {\n        \"acc_norm\"\
  : 0.46,\n        \"acc_norm_stderr\": 0.05009082659620332\n    },\n    \"community|arabic_mmlu:college_medicine|0\"\
  : {\n        \"acc_norm\": 0.43352601156069365,\n        \"acc_norm_stderr\": 0.03778621079092055\n\
  \    },\n    \"community|arabic_mmlu:college_physics|0\": {\n        \"acc_norm\"\
  : 0.43137254901960786,\n        \"acc_norm_stderr\": 0.04928099597287533\n    },\n\
  \    \"community|arabic_mmlu:computer_security|0\": {\n        \"acc_norm\": 0.65,\n\
  \        \"acc_norm_stderr\": 0.047937248544110196\n    },\n    \"community|arabic_mmlu:conceptual_physics|0\"\
  : {\n        \"acc_norm\": 0.6212765957446809,\n        \"acc_norm_stderr\": 0.031709956060406545\n\
  \    },\n    \"community|arabic_mmlu:econometrics|0\": {\n        \"acc_norm\":\
  \ 0.4824561403508772,\n        \"acc_norm_stderr\": 0.04700708033551038\n    },\n\
  \    \"community|arabic_mmlu:electrical_engineering|0\": {\n        \"acc_norm\"\
  : 0.47586206896551725,\n        \"acc_norm_stderr\": 0.0416180850350153\n    },\n\
  \    \"community|arabic_mmlu:elementary_mathematics|0\": {\n        \"acc_norm\"\
  : 0.626984126984127,\n        \"acc_norm_stderr\": 0.02490699045899257\n    },\n\
  \    \"community|arabic_mmlu:formal_logic|0\": {\n        \"acc_norm\": 0.46825396825396826,\n\
  \        \"acc_norm_stderr\": 0.04463112720677173\n    },\n    \"community|arabic_mmlu:global_facts|0\"\
  : {\n        \"acc_norm\": 0.37,\n        \"acc_norm_stderr\": 0.048523658709391\n\
  \    },\n    \"community|arabic_mmlu:high_school_biology|0\": {\n        \"acc_norm\"\
  : 0.5806451612903226,\n        \"acc_norm_stderr\": 0.02807158890109184\n    },\n\
  \    \"community|arabic_mmlu:high_school_chemistry|0\": {\n        \"acc_norm\"\
  : 0.5517241379310345,\n        \"acc_norm_stderr\": 0.034991131376767445\n    },\n\
  \    \"community|arabic_mmlu:high_school_computer_science|0\": {\n        \"acc_norm\"\
  : 0.8,\n        \"acc_norm_stderr\": 0.04020151261036846\n    },\n    \"community|arabic_mmlu:high_school_european_history|0\"\
  : {\n        \"acc_norm\": 0.24242424242424243,\n        \"acc_norm_stderr\": 0.03346409881055953\n\
  \    },\n    \"community|arabic_mmlu:high_school_geography|0\": {\n        \"acc_norm\"\
  : 0.6464646464646465,\n        \"acc_norm_stderr\": 0.03406086723547153\n    },\n\
  \    \"community|arabic_mmlu:high_school_government_and_politics|0\": {\n      \
  \  \"acc_norm\": 0.6062176165803109,\n        \"acc_norm_stderr\": 0.035260770955482405\n\
  \    },\n    \"community|arabic_mmlu:high_school_macroeconomics|0\": {\n       \
  \ \"acc_norm\": 0.5948717948717949,\n        \"acc_norm_stderr\": 0.024890471769938145\n\
  \    },\n    \"community|arabic_mmlu:high_school_mathematics|0\": {\n        \"\
  acc_norm\": 0.48518518518518516,\n        \"acc_norm_stderr\": 0.03047215324932859\n\
  \    },\n    \"community|arabic_mmlu:high_school_microeconomics|0\": {\n       \
  \ \"acc_norm\": 0.6134453781512605,\n        \"acc_norm_stderr\": 0.03163145807552379\n\
  \    },\n    \"community|arabic_mmlu:high_school_physics|0\": {\n        \"acc_norm\"\
  : 0.4503311258278146,\n        \"acc_norm_stderr\": 0.04062290018683775\n    },\n\
  \    \"community|arabic_mmlu:high_school_psychology|0\": {\n        \"acc_norm\"\
  : 0.6,\n        \"acc_norm_stderr\": 0.021004201260420075\n    },\n    \"community|arabic_mmlu:high_school_statistics|0\"\
  : {\n        \"acc_norm\": 0.5787037037037037,\n        \"acc_norm_stderr\": 0.03367462138896078\n\
  \    },\n    \"community|arabic_mmlu:high_school_us_history|0\": {\n        \"acc_norm\"\
  : 0.29901960784313725,\n        \"acc_norm_stderr\": 0.03213325717373617\n    },\n\
  \    \"community|arabic_mmlu:high_school_world_history|0\": {\n        \"acc_norm\"\
  : 0.33755274261603374,\n        \"acc_norm_stderr\": 0.03078154910202623\n    },\n\
  \    \"community|arabic_mmlu:human_aging|0\": {\n        \"acc_norm\": 0.5291479820627802,\n\
  \        \"acc_norm_stderr\": 0.03350073248773403\n    },\n    \"community|arabic_mmlu:human_sexuality|0\"\
  : {\n        \"acc_norm\": 0.5343511450381679,\n        \"acc_norm_stderr\": 0.043749285605997376\n\
  \    },\n    \"community|arabic_mmlu:international_law|0\": {\n        \"acc_norm\"\
  : 0.6859504132231405,\n        \"acc_norm_stderr\": 0.04236964753041018\n    },\n\
  \    \"community|arabic_mmlu:jurisprudence|0\": {\n        \"acc_norm\": 0.5462962962962963,\n\
  \        \"acc_norm_stderr\": 0.04812917324536823\n    },\n    \"community|arabic_mmlu:logical_fallacies|0\"\
  : {\n        \"acc_norm\": 0.5644171779141104,\n        \"acc_norm_stderr\": 0.03895632464138937\n\
  \    },\n    \"community|arabic_mmlu:machine_learning|0\": {\n        \"acc_norm\"\
  : 0.49107142857142855,\n        \"acc_norm_stderr\": 0.04745033255489123\n    },\n\
  \    \"community|arabic_mmlu:management|0\": {\n        \"acc_norm\": 0.6407766990291263,\n\
  \        \"acc_norm_stderr\": 0.04750458399041695\n    },\n    \"community|arabic_mmlu:marketing|0\"\
  : {\n        \"acc_norm\": 0.717948717948718,\n        \"acc_norm_stderr\": 0.029480360549541194\n\
  \    },\n    \"community|arabic_mmlu:medical_genetics|0\": {\n        \"acc_norm\"\
  : 0.51,\n        \"acc_norm_stderr\": 0.05024183937956913\n    },\n    \"community|arabic_mmlu:miscellaneous|0\"\
  : {\n        \"acc_norm\": 0.565772669220945,\n        \"acc_norm_stderr\": 0.01772458938967779\n\
  \    },\n    \"community|arabic_mmlu:moral_disputes|0\": {\n        \"acc_norm\"\
  : 0.5578034682080925,\n        \"acc_norm_stderr\": 0.026738603643807403\n    },\n\
  \    \"community|arabic_mmlu:moral_scenarios|0\": {\n        \"acc_norm\": 0.39888268156424583,\n\
  \        \"acc_norm_stderr\": 0.016376966142610073\n    },\n    \"community|arabic_mmlu:nutrition|0\"\
  : {\n        \"acc_norm\": 0.630718954248366,\n        \"acc_norm_stderr\": 0.027634176689602663\n\
  \    },\n    \"community|arabic_mmlu:philosophy|0\": {\n        \"acc_norm\": 0.5562700964630225,\n\
  \        \"acc_norm_stderr\": 0.028217683556652315\n    },\n    \"community|arabic_mmlu:prehistory|0\"\
  : {\n        \"acc_norm\": 0.5,\n        \"acc_norm_stderr\": 0.02782074420373286\n\
  \    },\n    \"community|arabic_mmlu:professional_accounting|0\": {\n        \"\
  acc_norm\": 0.35106382978723405,\n        \"acc_norm_stderr\": 0.028473501272963764\n\
  \    },\n    \"community|arabic_mmlu:professional_law|0\": {\n        \"acc_norm\"\
  : 0.31747066492829207,\n        \"acc_norm_stderr\": 0.011888892068809312\n    },\n\
  \    \"community|arabic_mmlu:professional_medicine|0\": {\n        \"acc_norm\"\
  : 0.27941176470588236,\n        \"acc_norm_stderr\": 0.027257202606114948\n    },\n\
  \    \"community|arabic_mmlu:professional_psychology|0\": {\n        \"acc_norm\"\
  : 0.4869281045751634,\n        \"acc_norm_stderr\": 0.020220920829626916\n    },\n\
  \    \"community|arabic_mmlu:public_relations|0\": {\n        \"acc_norm\": 0.5818181818181818,\n\
  \        \"acc_norm_stderr\": 0.04724577405731572\n    },\n    \"community|arabic_mmlu:security_studies|0\"\
  : {\n        \"acc_norm\": 0.6408163265306123,\n        \"acc_norm_stderr\": 0.030713560455108493\n\
  \    },\n    \"community|arabic_mmlu:sociology|0\": {\n        \"acc_norm\": 0.6318407960199005,\n\
  \        \"acc_norm_stderr\": 0.03410410565495301\n    },\n    \"community|arabic_mmlu:us_foreign_policy|0\"\
  : {\n        \"acc_norm\": 0.73,\n        \"acc_norm_stderr\": 0.044619604333847394\n\
  \    },\n    \"community|arabic_mmlu:virology|0\": {\n        \"acc_norm\": 0.3855421686746988,\n\
  \        \"acc_norm_stderr\": 0.037891344246115496\n    },\n    \"community|arabic_mmlu:world_religions|0\"\
  : {\n        \"acc_norm\": 0.5672514619883041,\n        \"acc_norm_stderr\": 0.037999786443706066\n\
  \    },\n    \"community|arc_challenge_okapi_ar|0\": {\n        \"acc_norm\": 0.4991379310344828,\n\
  \        \"acc_norm_stderr\": 0.014686815556709643\n    },\n    \"community|arc_easy_ar|0\"\
  : {\n        \"acc_norm\": 0.47250423011844334,\n        \"acc_norm_stderr\": 0.010270237345491042\n\
  \    },\n    \"community|boolq_ar|0\": {\n        \"acc_norm\": 0.650920245398773,\n\
  \        \"acc_norm_stderr\": 0.008349953183935178\n    },\n    \"community|copa_ext_ar|0\"\
  : {\n        \"acc_norm\": 0.5111111111111111,\n        \"acc_norm_stderr\": 0.05298680599073449\n\
  \    },\n    \"community|hellaswag_okapi_ar|0\": {\n        \"acc_norm\": 0.36331915821611604,\n\
  \        \"acc_norm_stderr\": 0.005022504941520044\n    },\n    \"community|openbook_qa_ext_ar|0\"\
  : {\n        \"acc_norm\": 0.49292929292929294,\n        \"acc_norm_stderr\": 0.022493814043998726\n\
  \    },\n    \"community|piqa_ar|0\": {\n        \"acc_norm\": 0.6524822695035462,\n\
  \        \"acc_norm_stderr\": 0.011125258386848799\n    },\n    \"community|race_ar|0\"\
  : {\n        \"acc_norm\": 0.4396429296003246,\n        \"acc_norm_stderr\": 0.0070704511335195844\n\
  \    },\n    \"community|sciq_ar|0\": {\n        \"acc_norm\": 0.5437185929648242,\n\
  \        \"acc_norm_stderr\": 0.015798297434857354\n    },\n    \"community|toxigen_ar|0\"\
  : {\n        \"acc_norm\": 0.4320855614973262,\n        \"acc_norm_stderr\": 0.01620887578524445\n\
  \    },\n    \"lighteval|xstory_cloze:ar|0\": {\n        \"acc\": 0.6406353408338848,\n\
  \        \"acc_stderr\": 0.01234765980210167\n    },\n    \"community|acva:_average|0\"\
  : {\n        \"acc_norm\": 0.3959054112377283,\n        \"acc_norm_stderr\": 0.04582032250576872\n\
  \    },\n    \"community|alghafa:_average|0\": {\n        \"acc_norm\": 0.4973961277483989,\n\
  \        \"acc_norm_stderr\": 0.022851266293553767\n    },\n    \"community|arabic_mmlu:_average|0\"\
  : {\n        \"acc_norm\": 0.5223550003775854,\n        \"acc_norm_stderr\": 0.0363688069584683\n\
  \    }\n}\n```"
repo_url: https://huggingface.co/RDson/CoderO1-DeepSeekR1-Coder-32B-Preview
configs:
- config_name: community_acva_Algeria_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Algeria|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Algeria|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Ancient_Egypt_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Ancient_Egypt|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Ancient_Egypt|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arab_Empire_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arab_Empire|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arab_Empire|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Architecture_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Architecture|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Architecture|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Art_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Art|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Art|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Astronomy_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Astronomy|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Astronomy|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Calligraphy_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Calligraphy|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Calligraphy|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Ceremony_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Ceremony|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Ceremony|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Clothing_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Clothing|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Clothing|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Culture_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Culture|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Culture|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Food_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Food|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Food|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Funeral_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Funeral|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Funeral|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Geography_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Geography|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Geography|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_History_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_History|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_History|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Language_Origin_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Language_Origin|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Language_Origin|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Literature_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Literature|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Literature|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Math_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Math|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Math|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Medicine_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Medicine|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Medicine|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Music_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Music|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Music|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Ornament_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Ornament|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Ornament|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Philosophy_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Philosophy|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Philosophy|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Physics_and_Chemistry_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Physics_and_Chemistry|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Physics_and_Chemistry|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Arabic_Wedding_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Arabic_Wedding|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Arabic_Wedding|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Bahrain_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Bahrain|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Bahrain|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Comoros_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Comoros|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Comoros|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Egypt_modern_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Egypt_modern|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Egypt_modern|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_InfluenceFromAncientEgypt_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:InfluenceFromAncientEgypt|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:InfluenceFromAncientEgypt|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_InfluenceFromByzantium_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:InfluenceFromByzantium|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:InfluenceFromByzantium|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_InfluenceFromChina_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:InfluenceFromChina|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:InfluenceFromChina|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_InfluenceFromGreece_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:InfluenceFromGreece|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:InfluenceFromGreece|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_InfluenceFromIslam_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:InfluenceFromIslam|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:InfluenceFromIslam|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_InfluenceFromPersia_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:InfluenceFromPersia|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:InfluenceFromPersia|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_InfluenceFromRome_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:InfluenceFromRome|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:InfluenceFromRome|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Iraq_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Iraq|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Iraq|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Islam_Education_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Islam_Education|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Islam_Education|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Islam_branches_and_schools_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Islam_branches_and_schools|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Islam_branches_and_schools|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Islamic_law_system_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Islamic_law_system|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Islamic_law_system|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Jordan_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Jordan|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Jordan|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Kuwait_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Kuwait|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Kuwait|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Lebanon_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Lebanon|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Lebanon|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Libya_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Libya|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Libya|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Mauritania_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Mauritania|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Mauritania|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Mesopotamia_civilization_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Mesopotamia_civilization|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Mesopotamia_civilization|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Morocco_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Morocco|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Morocco|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Oman_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Oman|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Oman|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Palestine_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Palestine|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Palestine|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Qatar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Qatar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Qatar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Saudi_Arabia_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Saudi_Arabia|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Saudi_Arabia|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Somalia_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Somalia|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Somalia|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Sudan_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Sudan|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Sudan|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Syria_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Syria|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Syria|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Tunisia_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Tunisia|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Tunisia|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_United_Arab_Emirates_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:United_Arab_Emirates|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:United_Arab_Emirates|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_Yemen_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:Yemen|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:Yemen|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_communication_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:communication|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:communication|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_computer_and_phone_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:computer_and_phone|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:computer_and_phone|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_daily_life_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:daily_life|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:daily_life|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_acva_entertainment_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|acva:entertainment|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|acva:entertainment|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_mcq_exams_test_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:mcq_exams_test_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:mcq_exams_test_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_meta_ar_dialects_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:meta_ar_dialects|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:meta_ar_dialects|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_meta_ar_msa_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:meta_ar_msa|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:meta_ar_msa|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_multiple_choice_facts_truefalse_balanced_task_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:multiple_choice_facts_truefalse_balanced_task|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:multiple_choice_facts_truefalse_balanced_task|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_multiple_choice_grounded_statement_soqal_task_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:multiple_choice_grounded_statement_soqal_task|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:multiple_choice_grounded_statement_soqal_task|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_multiple_choice_grounded_statement_xglue_mlqa_task_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_multiple_choice_rating_sentiment_no_neutral_task_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_multiple_choice_rating_sentiment_task_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:multiple_choice_rating_sentiment_task|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:multiple_choice_rating_sentiment_task|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_alghafa_multiple_choice_sentiment_task_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|alghafa:multiple_choice_sentiment_task|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|alghafa:multiple_choice_sentiment_task|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_exams_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_exams|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_exams|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_abstract_algebra_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:abstract_algebra|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:abstract_algebra|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_anatomy_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:anatomy|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:anatomy|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_astronomy_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:astronomy|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:astronomy|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_business_ethics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:business_ethics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:business_ethics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_clinical_knowledge_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:clinical_knowledge|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:clinical_knowledge|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_college_biology_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:college_biology|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:college_biology|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_college_chemistry_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:college_chemistry|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:college_chemistry|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_college_computer_science_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:college_computer_science|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:college_computer_science|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_college_mathematics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:college_mathematics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:college_mathematics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_college_medicine_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:college_medicine|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:college_medicine|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_college_physics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:college_physics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:college_physics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_computer_security_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:computer_security|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:computer_security|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_conceptual_physics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:conceptual_physics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:conceptual_physics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_econometrics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:econometrics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:econometrics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_electrical_engineering_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:electrical_engineering|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:electrical_engineering|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_elementary_mathematics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:elementary_mathematics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:elementary_mathematics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_formal_logic_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:formal_logic|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:formal_logic|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_global_facts_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:global_facts|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:global_facts|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_biology_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_biology|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_biology|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_chemistry_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_chemistry|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_chemistry|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_computer_science_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_computer_science|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_computer_science|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_european_history_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_european_history|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_european_history|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_geography_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_geography|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_geography|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_government_and_politics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_government_and_politics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_government_and_politics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_macroeconomics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_macroeconomics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_macroeconomics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_mathematics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_mathematics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_mathematics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_microeconomics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_microeconomics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_microeconomics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_physics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_physics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_physics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_psychology_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_psychology|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_psychology|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_statistics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_statistics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_statistics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_us_history_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_us_history|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_us_history|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_high_school_world_history_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:high_school_world_history|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:high_school_world_history|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_human_aging_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:human_aging|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:human_aging|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_human_sexuality_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:human_sexuality|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:human_sexuality|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_international_law_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:international_law|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:international_law|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_jurisprudence_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:jurisprudence|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:jurisprudence|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_logical_fallacies_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:logical_fallacies|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:logical_fallacies|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_machine_learning_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:machine_learning|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:machine_learning|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_management_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:management|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:management|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_marketing_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:marketing|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:marketing|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_medical_genetics_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:medical_genetics|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:medical_genetics|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_miscellaneous_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:miscellaneous|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:miscellaneous|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_moral_disputes_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:moral_disputes|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:moral_disputes|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_moral_scenarios_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:moral_scenarios|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:moral_scenarios|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_nutrition_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:nutrition|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:nutrition|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_philosophy_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:philosophy|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:philosophy|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_prehistory_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:prehistory|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:prehistory|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_professional_accounting_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:professional_accounting|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:professional_accounting|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_professional_law_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:professional_law|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:professional_law|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_professional_medicine_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:professional_medicine|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:professional_medicine|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_professional_psychology_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:professional_psychology|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:professional_psychology|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_public_relations_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:public_relations|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:public_relations|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_security_studies_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:security_studies|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:security_studies|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_sociology_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:sociology|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:sociology|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_us_foreign_policy_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:us_foreign_policy|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:us_foreign_policy|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_virology_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:virology|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:virology|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arabic_mmlu_world_religions_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arabic_mmlu:world_religions|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arabic_mmlu:world_religions|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arc_challenge_okapi_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arc_challenge_okapi_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arc_challenge_okapi_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_arc_easy_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|arc_easy_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|arc_easy_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_boolq_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|boolq_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|boolq_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_copa_ext_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|copa_ext_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|copa_ext_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_hellaswag_okapi_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|hellaswag_okapi_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|hellaswag_okapi_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_openbook_qa_ext_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|openbook_qa_ext_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|openbook_qa_ext_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_piqa_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|piqa_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|piqa_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_race_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|race_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|race_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_sciq_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|sciq_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|sciq_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: community_toxigen_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_community|toxigen_ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_community|toxigen_ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: lighteval_xstory_cloze_ar_0_2025_02_06T15_40_51_477476_parquet
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - '**/details_lighteval|xstory_cloze:ar|0_2025-02-06T15-40-51.477476.parquet'
  - split: latest
    path:
    - '**/details_lighteval|xstory_cloze:ar|0_2025-02-06T15-40-51.477476.parquet'
- config_name: results
  data_files:
  - split: 2025_02_06T15_40_51.477476
    path:
    - results_2025-02-06T15-40-51.477476.parquet
  - split: latest
    path:
    - results_2025-02-06T15-40-51.477476.parquet
---

# Dataset Card for Evaluation run of RDson/CoderO1-DeepSeekR1-Coder-32B-Preview

<!-- Provide a quick summary of the dataset. -->

Dataset automatically created during the evaluation run of model [RDson/CoderO1-DeepSeekR1-Coder-32B-Preview](https://huggingface.co/RDson/CoderO1-DeepSeekR1-Coder-32B-Preview).

The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.

The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.

An additional configuration "results" store all the aggregated results of the run.

To load the details from a run, you can for instance do the following:
```python
from datasets import load_dataset
data = load_dataset("OALL/details_RDson__CoderO1-DeepSeekR1-Coder-32B-Preview",
	"lighteval_xstory_cloze_ar_0_2025_02_06T15_40_51_477476_parquet",
	split="train")
```

## Latest results

These are the [latest results from run 2025-02-06T15:40:51.477476](https://huggingface.co/datasets/OALL/details_RDson__CoderO1-DeepSeekR1-Coder-32B-Preview/blob/main/results_2025-02-06T15-40-51.477476.json)(note that their might be results for other tasks in the repos if successive evals didn't cover the same tasks. You find each in the results and the "latest" split for each eval):

```python
{
    "all": {
        "acc_norm": 0.4650750505619803,
        "acc_norm_stderr": 0.037939728859166695,
        "acc": 0.6406353408338848,
        "acc_stderr": 0.01234765980210167
    },
    "community|acva:Algeria|0": {
        "acc_norm": 0.5230769230769231,
        "acc_norm_stderr": 0.0358596530894741
    },
    "community|acva:Ancient_Egypt|0": {
        "acc_norm": 0.050793650793650794,
        "acc_norm_stderr": 0.01239139518482262
    },
    "community|acva:Arab_Empire|0": {
        "acc_norm": 0.30943396226415093,
        "acc_norm_stderr": 0.028450154794118627
    },
    "community|acva:Arabic_Architecture|0": {
        "acc_norm": 0.4564102564102564,
        "acc_norm_stderr": 0.035761230969912135
    },
    "community|acva:Arabic_Art|0": {
        "acc_norm": 0.3641025641025641,
        "acc_norm_stderr": 0.03454653867786389
    },
    "community|acva:Arabic_Astronomy|0": {
        "acc_norm": 0.4666666666666667,
        "acc_norm_stderr": 0.03581804596782233
    },
    "community|acva:Arabic_Calligraphy|0": {
        "acc_norm": 0.47843137254901963,
        "acc_norm_stderr": 0.0313435870640056
    },
    "community|acva:Arabic_Ceremony|0": {
        "acc_norm": 0.518918918918919,
        "acc_norm_stderr": 0.036834092970087065
    },
    "community|acva:Arabic_Clothing|0": {
        "acc_norm": 0.5128205128205128,
        "acc_norm_stderr": 0.03588610523192215
    },
    "community|acva:Arabic_Culture|0": {
        "acc_norm": 0.23076923076923078,
        "acc_norm_stderr": 0.0302493752938313
    },
    "community|acva:Arabic_Food|0": {
        "acc_norm": 0.441025641025641,
        "acc_norm_stderr": 0.0356473293185358
    },
    "community|acva:Arabic_Funeral|0": {
        "acc_norm": 0.4,
        "acc_norm_stderr": 0.050529115263991134
    },
    "community|acva:Arabic_Geography|0": {
        "acc_norm": 0.6068965517241379,
        "acc_norm_stderr": 0.040703290137070705
    },
    "community|acva:Arabic_History|0": {
        "acc_norm": 0.30256410256410254,
        "acc_norm_stderr": 0.03298070870085619
    },
    "community|acva:Arabic_Language_Origin|0": {
        "acc_norm": 0.5473684210526316,
        "acc_norm_stderr": 0.051339113773544845
    },
    "community|acva:Arabic_Literature|0": {
        "acc_norm": 0.47586206896551725,
        "acc_norm_stderr": 0.041618085035015295
    },
    "community|acva:Arabic_Math|0": {
        "acc_norm": 0.30256410256410254,
        "acc_norm_stderr": 0.03298070870085618
    },
    "community|acva:Arabic_Medicine|0": {
        "acc_norm": 0.46206896551724136,
        "acc_norm_stderr": 0.041546596717075474
    },
    "community|acva:Arabic_Music|0": {
        "acc_norm": 0.23741007194244604,
        "acc_norm_stderr": 0.036220593237998276
    },
    "community|acva:Arabic_Ornament|0": {
        "acc_norm": 0.4717948717948718,
        "acc_norm_stderr": 0.035840746749208334
    },
    "community|acva:Arabic_Philosophy|0": {
        "acc_norm": 0.5793103448275863,
        "acc_norm_stderr": 0.0411391498118926
    },
    "community|acva:Arabic_Physics_and_Chemistry|0": {
        "acc_norm": 0.5333333333333333,
        "acc_norm_stderr": 0.03581804596782232
    },
    "community|acva:Arabic_Wedding|0": {
        "acc_norm": 0.41025641025641024,
        "acc_norm_stderr": 0.03531493712326671
    },
    "community|acva:Bahrain|0": {
        "acc_norm": 0.3111111111111111,
        "acc_norm_stderr": 0.06979205927323111
    },
    "community|acva:Comoros|0": {
        "acc_norm": 0.37777777777777777,
        "acc_norm_stderr": 0.07309112127323451
    },
    "community|acva:Egypt_modern|0": {
        "acc_norm": 0.3157894736842105,
        "acc_norm_stderr": 0.04794350420740798
    },
    "community|acva:InfluenceFromAncientEgypt|0": {
        "acc_norm": 0.6051282051282051,
        "acc_norm_stderr": 0.03509545602262038
    },
    "community|acva:InfluenceFromByzantium|0": {
        "acc_norm": 0.7172413793103448,
        "acc_norm_stderr": 0.03752833958003337
    },
    "community|acva:InfluenceFromChina|0": {
        "acc_norm": 0.26666666666666666,
        "acc_norm_stderr": 0.0317493043641267
    },
    "community|acva:InfluenceFromGreece|0": {
        "acc_norm": 0.6307692307692307,
        "acc_norm_stderr": 0.034648411418637566
    },
    "community|acva:InfluenceFromIslam|0": {
        "acc_norm": 0.296551724137931,
        "acc_norm_stderr": 0.03806142687309993
    },
    "community|acva:InfluenceFromPersia|0": {
        "acc_norm": 0.6971428571428572,
        "acc_norm_stderr": 0.03483414676585986
    },
    "community|acva:InfluenceFromRome|0": {
        "acc_norm": 0.5743589743589743,
        "acc_norm_stderr": 0.03549871080367708
    },
    "community|acva:Iraq|0": {
        "acc_norm": 0.5058823529411764,
        "acc_norm_stderr": 0.05455069703232772
    },
    "community|acva:Islam_Education|0": {
        "acc_norm": 0.4512820512820513,
        "acc_norm_stderr": 0.03572709860318392
    },
    "community|acva:Islam_branches_and_schools|0": {
        "acc_norm": 0.4342857142857143,
        "acc_norm_stderr": 0.037576101528126626
    },
    "community|acva:Islamic_law_system|0": {
        "acc_norm": 0.4256410256410256,
        "acc_norm_stderr": 0.035498710803677086
    },
    "community|acva:Jordan|0": {
        "acc_norm": 0.35555555555555557,
        "acc_norm_stderr": 0.07216392363431012
    },
    "community|acva:Kuwait|0": {
        "acc_norm": 0.26666666666666666,
        "acc_norm_stderr": 0.06666666666666667
    },
    "community|acva:Lebanon|0": {
        "acc_norm": 0.17777777777777778,
        "acc_norm_stderr": 0.05763774795025094
    },
    "community|acva:Libya|0": {
        "acc_norm": 0.4444444444444444,
        "acc_norm_stderr": 0.07491109582924914
    },
    "community|acva:Mauritania|0": {
        "acc_norm": 0.4222222222222222,
        "acc_norm_stderr": 0.07446027270295805
    },
    "community|acva:Mesopotamia_civilization|0": {
        "acc_norm": 0.5225806451612903,
        "acc_norm_stderr": 0.0402500394824441
    },
    "community|acva:Morocco|0": {
        "acc_norm": 0.2222222222222222,
        "acc_norm_stderr": 0.06267511942419628
    },
    "community|acva:Oman|0": {
        "acc_norm": 0.17777777777777778,
        "acc_norm_stderr": 0.05763774795025094
    },
    "community|acva:Palestine|0": {
        "acc_norm": 0.24705882352941178,
        "acc_norm_stderr": 0.047058823529411785
    },
    "community|acva:Qatar|0": {
        "acc_norm": 0.4,
        "acc_norm_stderr": 0.07385489458759964
    },
    "community|acva:Saudi_Arabia|0": {
        "acc_norm": 0.3435897435897436,
        "acc_norm_stderr": 0.03409627301409855
    },
    "community|acva:Somalia|0": {
        "acc_norm": 0.35555555555555557,
        "acc_norm_stderr": 0.07216392363431012
    },
    "community|acva:Sudan|0": {
        "acc_norm": 0.35555555555555557,
        "acc_norm_stderr": 0.07216392363431012
    },
    "community|acva:Syria|0": {
        "acc_norm": 0.3333333333333333,
        "acc_norm_stderr": 0.07106690545187012
    },
    "community|acva:Tunisia|0": {
        "acc_norm": 0.3111111111111111,
        "acc_norm_stderr": 0.06979205927323111
    },
    "community|acva:United_Arab_Emirates|0": {
        "acc_norm": 0.23529411764705882,
        "acc_norm_stderr": 0.04628210543937907
    },
    "community|acva:Yemen|0": {
        "acc_norm": 0.2,
        "acc_norm_stderr": 0.13333333333333333
    },
    "community|acva:communication|0": {
        "acc_norm": 0.42857142857142855,
        "acc_norm_stderr": 0.025974025974025955
    },
    "community|acva:computer_and_phone|0": {
        "acc_norm": 0.45084745762711864,
        "acc_norm_stderr": 0.02901934773187137
    },
    "community|acva:daily_life|0": {
        "acc_norm": 0.18694362017804153,
        "acc_norm_stderr": 0.021268948348414647
    },
    "community|acva:entertainment|0": {
        "acc_norm": 0.23389830508474577,
        "acc_norm_stderr": 0.024687839412166384
    },
    "community|alghafa:mcq_exams_test_ar|0": {
        "acc_norm": 0.36983842010771995,
        "acc_norm_stderr": 0.020473617130765447
    },
    "community|alghafa:meta_ar_dialects|0": {
        "acc_norm": 0.38591288229842446,
        "acc_norm_stderr": 0.006628330583807984
    },
    "community|alghafa:meta_ar_msa|0": {
        "acc_norm": 0.4201117318435754,
        "acc_norm_stderr": 0.016507671073256402
    },
    "community|alghafa:multiple_choice_facts_truefalse_balanced_task|0": {
        "acc_norm": 0.52,
        "acc_norm_stderr": 0.05807730170189531
    },
    "community|alghafa:multiple_choice_grounded_statement_soqal_task|0": {
        "acc_norm": 0.5866666666666667,
        "acc_norm_stderr": 0.040341569222180455
    },
    "community|alghafa:multiple_choice_grounded_statement_xglue_mlqa_task|0": {
        "acc_norm": 0.46,
        "acc_norm_stderr": 0.04083030852148599
    },
    "community|alghafa:multiple_choice_rating_sentiment_no_neutral_task|0": {
        "acc_norm": 0.7892432770481551,
        "acc_norm_stderr": 0.004561567357594509
    },
    "community|alghafa:multiple_choice_rating_sentiment_task|0": {
        "acc_norm": 0.5459549624687239,
        "acc_norm_stderr": 0.006430866682158502
    },
    "community|alghafa:multiple_choice_sentiment_task|0": {
        "acc_norm": 0.3988372093023256,
        "acc_norm_stderr": 0.01181016436883932
    },
    "community|arabic_exams|0": {
        "acc_norm": 0.5139664804469274,
        "acc_norm_stderr": 0.021588283575384216
    },
    "community|arabic_mmlu:abstract_algebra|0": {
        "acc_norm": 0.37,
        "acc_norm_stderr": 0.04852365870939099
    },
    "community|arabic_mmlu:anatomy|0": {
        "acc_norm": 0.3851851851851852,
        "acc_norm_stderr": 0.042039210401562783
    },
    "community|arabic_mmlu:astronomy|0": {
        "acc_norm": 0.6381578947368421,
        "acc_norm_stderr": 0.03910525752849724
    },
    "community|arabic_mmlu:business_ethics|0": {
        "acc_norm": 0.58,
        "acc_norm_stderr": 0.049604496374885836
    },
    "community|arabic_mmlu:clinical_knowledge|0": {
        "acc_norm": 0.5283018867924528,
        "acc_norm_stderr": 0.0307235352490061
    },
    "community|arabic_mmlu:college_biology|0": {
        "acc_norm": 0.5347222222222222,
        "acc_norm_stderr": 0.04171115858181618
    },
    "community|arabic_mmlu:college_chemistry|0": {
        "acc_norm": 0.47,
        "acc_norm_stderr": 0.050161355804659205
    },
    "community|arabic_mmlu:college_computer_science|0": {
        "acc_norm": 0.46,
        "acc_norm_stderr": 0.05009082659620333
    },
    "community|arabic_mmlu:college_mathematics|0": {
        "acc_norm": 0.46,
        "acc_norm_stderr": 0.05009082659620332
    },
    "community|arabic_mmlu:college_medicine|0": {
        "acc_norm": 0.43352601156069365,
        "acc_norm_stderr": 0.03778621079092055
    },
    "community|arabic_mmlu:college_physics|0": {
        "acc_norm": 0.43137254901960786,
        "acc_norm_stderr": 0.04928099597287533
    },
    "community|arabic_mmlu:computer_security|0": {
        "acc_norm": 0.65,
        "acc_norm_stderr": 0.047937248544110196
    },
    "community|arabic_mmlu:conceptual_physics|0": {
        "acc_norm": 0.6212765957446809,
        "acc_norm_stderr": 0.031709956060406545
    },
    "community|arabic_mmlu:econometrics|0": {
        "acc_norm": 0.4824561403508772,
        "acc_norm_stderr": 0.04700708033551038
    },
    "community|arabic_mmlu:electrical_engineering|0": {
        "acc_norm": 0.47586206896551725,
        "acc_norm_stderr": 0.0416180850350153
    },
    "community|arabic_mmlu:elementary_mathematics|0": {
        "acc_norm": 0.626984126984127,
        "acc_norm_stderr": 0.02490699045899257
    },
    "community|arabic_mmlu:formal_logic|0": {
        "acc_norm": 0.46825396825396826,
        "acc_norm_stderr": 0.04463112720677173
    },
    "community|arabic_mmlu:global_facts|0": {
        "acc_norm": 0.37,
        "acc_norm_stderr": 0.048523658709391
    },
    "community|arabic_mmlu:high_school_biology|0": {
        "acc_norm": 0.5806451612903226,
        "acc_norm_stderr": 0.02807158890109184
    },
    "community|arabic_mmlu:high_school_chemistry|0": {
        "acc_norm": 0.5517241379310345,
        "acc_norm_stderr": 0.034991131376767445
    },
    "community|arabic_mmlu:high_school_computer_science|0": {
        "acc_norm": 0.8,
        "acc_norm_stderr": 0.04020151261036846
    },
    "community|arabic_mmlu:high_school_european_history|0": {
        "acc_norm": 0.24242424242424243,
        "acc_norm_stderr": 0.03346409881055953
    },
    "community|arabic_mmlu:high_school_geography|0": {
        "acc_norm": 0.6464646464646465,
        "acc_norm_stderr": 0.03406086723547153
    },
    "community|arabic_mmlu:high_school_government_and_politics|0": {
        "acc_norm": 0.6062176165803109,
        "acc_norm_stderr": 0.035260770955482405
    },
    "community|arabic_mmlu:high_school_macroeconomics|0": {
        "acc_norm": 0.5948717948717949,
        "acc_norm_stderr": 0.024890471769938145
    },
    "community|arabic_mmlu:high_school_mathematics|0": {
        "acc_norm": 0.48518518518518516,
        "acc_norm_stderr": 0.03047215324932859
    },
    "community|arabic_mmlu:high_school_microeconomics|0": {
        "acc_norm": 0.6134453781512605,
        "acc_norm_stderr": 0.03163145807552379
    },
    "community|arabic_mmlu:high_school_physics|0": {
        "acc_norm": 0.4503311258278146,
        "acc_norm_stderr": 0.04062290018683775
    },
    "community|arabic_mmlu:high_school_psychology|0": {
        "acc_norm": 0.6,
        "acc_norm_stderr": 0.021004201260420075
    },
    "community|arabic_mmlu:high_school_statistics|0": {
        "acc_norm": 0.5787037037037037,
        "acc_norm_stderr": 0.03367462138896078
    },
    "community|arabic_mmlu:high_school_us_history|0": {
        "acc_norm": 0.29901960784313725,
        "acc_norm_stderr": 0.03213325717373617
    },
    "community|arabic_mmlu:high_school_world_history|0": {
        "acc_norm": 0.33755274261603374,
        "acc_norm_stderr": 0.03078154910202623
    },
    "community|arabic_mmlu:human_aging|0": {
        "acc_norm": 0.5291479820627802,
        "acc_norm_stderr": 0.03350073248773403
    },
    "community|arabic_mmlu:human_sexuality|0": {
        "acc_norm": 0.5343511450381679,
        "acc_norm_stderr": 0.043749285605997376
    },
    "community|arabic_mmlu:international_law|0": {
        "acc_norm": 0.6859504132231405,
        "acc_norm_stderr": 0.04236964753041018
    },
    "community|arabic_mmlu:jurisprudence|0": {
        "acc_norm": 0.5462962962962963,
        "acc_norm_stderr": 0.04812917324536823
    },
    "community|arabic_mmlu:logical_fallacies|0": {
        "acc_norm": 0.5644171779141104,
        "acc_norm_stderr": 0.03895632464138937
    },
    "community|arabic_mmlu:machine_learning|0": {
        "acc_norm": 0.49107142857142855,
        "acc_norm_stderr": 0.04745033255489123
    },
    "community|arabic_mmlu:management|0": {
        "acc_norm": 0.6407766990291263,
        "acc_norm_stderr": 0.04750458399041695
    },
    "community|arabic_mmlu:marketing|0": {
        "acc_norm": 0.717948717948718,
        "acc_norm_stderr": 0.029480360549541194
    },
    "community|arabic_mmlu:medical_genetics|0": {
        "acc_norm": 0.51,
        "acc_norm_stderr": 0.05024183937956913
    },
    "community|arabic_mmlu:miscellaneous|0": {
        "acc_norm": 0.565772669220945,
        "acc_norm_stderr": 0.01772458938967779
    },
    "community|arabic_mmlu:moral_disputes|0": {
        "acc_norm": 0.5578034682080925,
        "acc_norm_stderr": 0.026738603643807403
    },
    "community|arabic_mmlu:moral_scenarios|0": {
        "acc_norm": 0.39888268156424583,
        "acc_norm_stderr": 0.016376966142610073
    },
    "community|arabic_mmlu:nutrition|0": {
        "acc_norm": 0.630718954248366,
        "acc_norm_stderr": 0.027634176689602663
    },
    "community|arabic_mmlu:philosophy|0": {
        "acc_norm": 0.5562700964630225,
        "acc_norm_stderr": 0.028217683556652315
    },
    "community|arabic_mmlu:prehistory|0": {
        "acc_norm": 0.5,
        "acc_norm_stderr": 0.02782074420373286
    },
    "community|arabic_mmlu:professional_accounting|0": {
        "acc_norm": 0.35106382978723405,
        "acc_norm_stderr": 0.028473501272963764
    },
    "community|arabic_mmlu:professional_law|0": {
        "acc_norm": 0.31747066492829207,
        "acc_norm_stderr": 0.011888892068809312
    },
    "community|arabic_mmlu:professional_medicine|0": {
        "acc_norm": 0.27941176470588236,
        "acc_norm_stderr": 0.027257202606114948
    },
    "community|arabic_mmlu:professional_psychology|0": {
        "acc_norm": 0.4869281045751634,
        "acc_norm_stderr": 0.020220920829626916
    },
    "community|arabic_mmlu:public_relations|0": {
        "acc_norm": 0.5818181818181818,
        "acc_norm_stderr": 0.04724577405731572
    },
    "community|arabic_mmlu:security_studies|0": {
        "acc_norm": 0.6408163265306123,
        "acc_norm_stderr": 0.030713560455108493
    },
    "community|arabic_mmlu:sociology|0": {
        "acc_norm": 0.6318407960199005,
        "acc_norm_stderr": 0.03410410565495301
    },
    "community|arabic_mmlu:us_foreign_policy|0": {
        "acc_norm": 0.73,
        "acc_norm_stderr": 0.044619604333847394
    },
    "community|arabic_mmlu:virology|0": {
        "acc_norm": 0.3855421686746988,
        "acc_norm_stderr": 0.037891344246115496
    },
    "community|arabic_mmlu:world_religions|0": {
        "acc_norm": 0.5672514619883041,
        "acc_norm_stderr": 0.037999786443706066
    },
    "community|arc_challenge_okapi_ar|0": {
        "acc_norm": 0.4991379310344828,
        "acc_norm_stderr": 0.014686815556709643
    },
    "community|arc_easy_ar|0": {
        "acc_norm": 0.47250423011844334,
        "acc_norm_stderr": 0.010270237345491042
    },
    "community|boolq_ar|0": {
        "acc_norm": 0.650920245398773,
        "acc_norm_stderr": 0.008349953183935178
    },
    "community|copa_ext_ar|0": {
        "acc_norm": 0.5111111111111111,
        "acc_norm_stderr": 0.05298680599073449
    },
    "community|hellaswag_okapi_ar|0": {
        "acc_norm": 0.36331915821611604,
        "acc_norm_stderr": 0.005022504941520044
    },
    "community|openbook_qa_ext_ar|0": {
        "acc_norm": 0.49292929292929294,
        "acc_norm_stderr": 0.022493814043998726
    },
    "community|piqa_ar|0": {
        "acc_norm": 0.6524822695035462,
        "acc_norm_stderr": 0.011125258386848799
    },
    "community|race_ar|0": {
        "acc_norm": 0.4396429296003246,
        "acc_norm_stderr": 0.0070704511335195844
    },
    "community|sciq_ar|0": {
        "acc_norm": 0.5437185929648242,
        "acc_norm_stderr": 0.015798297434857354
    },
    "community|toxigen_ar|0": {
        "acc_norm": 0.4320855614973262,
        "acc_norm_stderr": 0.01620887578524445
    },
    "lighteval|xstory_cloze:ar|0": {
        "acc": 0.6406353408338848,
        "acc_stderr": 0.01234765980210167
    },
    "community|acva:_average|0": {
        "acc_norm": 0.3959054112377283,
        "acc_norm_stderr": 0.04582032250576872
    },
    "community|alghafa:_average|0": {
        "acc_norm": 0.4973961277483989,
        "acc_norm_stderr": 0.022851266293553767
    },
    "community|arabic_mmlu:_average|0": {
        "acc_norm": 0.5223550003775854,
        "acc_norm_stderr": 0.0363688069584683
    }
}
```

## Dataset Details

### Dataset Description

<!-- Provide a longer summary of what this dataset is. -->



- **Curated by:** [More Information Needed]
- **Funded by [optional]:** [More Information Needed]
- **Shared by [optional]:** [More Information Needed]
- **Language(s) (NLP):** [More Information Needed]
- **License:** [More Information Needed]

### Dataset Sources [optional]

<!-- Provide the basic links for the dataset. -->

- **Repository:** [More Information Needed]
- **Paper [optional]:** [More Information Needed]
- **Demo [optional]:** [More Information Needed]

## Uses

<!-- Address questions around how the dataset is intended to be used. -->

### Direct Use

<!-- This section describes suitable use cases for the dataset. -->

[More Information Needed]

### Out-of-Scope Use

<!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. -->

[More Information Needed]

## Dataset Structure

<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->

[More Information Needed]

## Dataset Creation

### Curation Rationale

<!-- Motivation for the creation of this dataset. -->

[More Information Needed]

### Source Data

<!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). -->

#### Data Collection and Processing

<!-- This section describes the data collection and processing process such as data selection criteria, filtering and normalization methods, tools and libraries used, etc. -->

[More Information Needed]

#### Who are the source data producers?

<!-- This section describes the people or systems who originally created the data. It should also include self-reported demographic or identity information for the source data creators if this information is available. -->

[More Information Needed]

### Annotations [optional]

<!-- If the dataset contains annotations which are not part of the initial data collection, use this section to describe them. -->

#### Annotation process

<!-- This section describes the annotation process such as annotation tools used in the process, the amount of data annotated, annotation guidelines provided to the annotators, interannotator statistics, annotation validation, etc. -->

[More Information Needed]

#### Who are the annotators?

<!-- This section describes the people or systems who created the annotations. -->

[More Information Needed]

#### Personal and Sensitive Information

<!-- State whether the dataset contains data that might be considered personal, sensitive, or private (e.g., data that reveals addresses, uniquely identifiable names or aliases, racial or ethnic origins, sexual orientations, religious beliefs, political opinions, financial or health data, etc.). If efforts were made to anonymize the data, describe the anonymization process. -->

[More Information Needed]

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

[More Information Needed]

### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users should be made aware of the risks, biases and limitations of the dataset. More information needed for further recommendations.

## Citation [optional]

<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->

**BibTeX:**

[More Information Needed]

**APA:**

[More Information Needed]

## Glossary [optional]

<!-- If relevant, include terms and calculations in this section that can help readers understand the dataset or dataset card. -->

[More Information Needed]

## More Information [optional]

[More Information Needed]

## Dataset Card Authors [optional]

[More Information Needed]

## Dataset Card Contact

[More Information Needed]