MambaTree
[NeurIPS2024 Spotlight] The official implementation of MambaTree: Tree Topology is All You Need in State Space Model
파일 탐색기
최종 버전 다운로드 (.zip)파일 수가 많아 일부만 표시됩니다. 전체 파일은 위 다운로드 버튼으로 확인해 주세요.
- new_tasks.yml
- unit_tests.yml
- fewshot_example_gpt3.png
- decontamination.md
- interface.md
- model_guide.md
- new_task_guide.md
- README.md
- task_guide.md
- README.md
- README.md
- __init__.py
- filter.py
- instance.py
- metrics.py
- model.py
- registry.py
- samplers.py
- task.py
- __init__.py
- archiver.py
- decontaminate.py
- janitor.py
- __init__.py
- decontamination.py
- extraction.py
- selection.py
- transformation.py
- __init__.py
- anthropic_llms.py
- dummy.py
- huggingface.py
- openai_completions.py
- textsynth.py
- __init__.py
- anli_r1.yaml
- anli_r2.yaml
- anli_r3.yaml
- README.md
- arc_challenge.yaml
- arc_easy.yaml
- README.md
- arithmetic_1dc.yaml
- arithmetic_2da.yaml
- arithmetic_2dm.yaml
- arithmetic_2ds.yaml
- arithmetic_3da.yaml
- arithmetic_3ds.yaml
- arithmetic_4da.yaml
- arithmetic_4ds.yaml
- arithmetic_5da.yaml
- arithmetic_5ds.yaml
- README.md
- default.yaml
- README.md
- babi.yaml
- README.md
- _flan_cot_fewshot_template_yaml
- boolean_expressions.yaml
- causal_judgement.yaml
- date_understanding.yaml
- disambiguation_qa.yaml
- dyck_languages.yaml
- formal_fallacies.yaml
- geometric_shapes.yaml
- hyperbaton.yaml
- logical_deduction_five_objects.yaml
- logical_deduction_seven_objects.yaml
- logical_deduction_three_objects.yaml
- movie_recommendation.yaml
- multistep_arithmetic_two.yaml
- navigate.yaml
- object_counting.yaml
- penguins_in_a_table.yaml
- reasoning_about_colored_objects.yaml
- ruin_names.yaml
- salient_translation_error_detection.yaml
- snarks.yaml
- sports_understanding.yaml
- temporal_sequences.yaml
- tracking_shuffled_objects_five_objects.yaml
- tracking_shuffled_objects_seven_objects.yaml
- tracking_shuffled_objects_three_objects.yaml
- web_of_lies.yaml
- word_sorting.yaml
- _flan_cot_zeroshot_template_yaml
- boolean_expressions.yaml
- causal_judgement.yaml
- date_understanding.yaml
- disambiguation_qa.yaml
- dyck_languages.yaml
- formal_fallacies.yaml
- geometric_shapes.yaml
- hyperbaton.yaml
- logical_deduction_five_objects.yaml
- logical_deduction_seven_objects.yaml
- logical_deduction_three_objects.yaml
- movie_recommendation.yaml
- multistep_arithmetic_two.yaml
- navigate.yaml
- object_counting.yaml
- penguins_in_a_table.yaml
- reasoning_about_colored_objects.yaml
- ruin_names.yaml
- salient_translation_error_detection.yaml
- snarks.yaml
- sports_understanding.yaml
- temporal_sequences.yaml
- tracking_shuffled_objects_five_objects.yaml
- tracking_shuffled_objects_seven_objects.yaml
- tracking_shuffled_objects_three_objects.yaml
- web_of_lies.yaml
- word_sorting.yaml
- _flan_fewshot_template_yaml
- boolean_expressions.yaml
- causal_judgement.yaml
- date_understanding.yaml
- disambiguation_qa.yaml
- dyck_languages.yaml
- formal_fallacies.yaml
- geometric_shapes.yaml
- hyperbaton.yaml
- logical_deduction_five_objects.yaml
- logical_deduction_seven_objects.yaml
- logical_deduction_three_objects.yaml
- movie_recommendation.yaml
- multistep_arithmetic_two.yaml
- navigate.yaml
- object_counting.yaml
- penguins_in_a_table.yaml
- reasoning_about_colored_objects.yaml
- ruin_names.yaml
- salient_translation_error_detection.yaml
- snarks.yaml
- sports_understanding.yaml
- temporal_sequences.yaml
- tracking_shuffled_objects_five_objects.yaml
- tracking_shuffled_objects_seven_objects.yaml
- tracking_shuffled_objects_three_objects.yaml
- web_of_lies.yaml
- word_sorting.yaml
- _flan_zeroshot_template_yaml
- boolean_expressions.yaml
- causal_judgement.yaml
- date_understanding.yaml
- disambiguation_qa.yaml
- dyck_languages.yaml
- formal_fallacies.yaml
- geometric_shapes.yaml
- hyperbaton.yaml
- logical_deduction_five_objects.yaml
- logical_deduction_seven_objects.yaml
- logical_deduction_three_objects.yaml
- movie_recommendation.yaml
- multistep_arithmetic_two.yaml
- navigate.yaml
- object_counting.yaml
- penguins_in_a_table.yaml
- reasoning_about_colored_objects.yaml
- ruin_names.yaml
- salient_translation_error_detection.yaml
- snarks.yaml
- sports_understanding.yaml
- temporal_sequences.yaml
- tracking_shuffled_objects_five_objects.yaml
- tracking_shuffled_objects_seven_objects.yaml
- tracking_shuffled_objects_three_objects.yaml
- web_of_lies.yaml
- word_sorting.yaml
- _generate_configs.py
- README.md
- _default_template_yaml
- _generate_configs.py
- belebele_acm_Arab.yaml
- belebele_afr_Latn.yaml
- belebele_als_Latn.yaml
- belebele_amh_Ethi.yaml
- belebele_apc_Arab.yaml
- belebele_arb_Arab.yaml
- belebele_arb_Latn.yaml
- belebele_ars_Arab.yaml
- belebele_ary_Arab.yaml
- belebele_arz_Arab.yaml
- belebele_asm_Beng.yaml
- belebele_azj_Latn.yaml
- belebele_bam_Latn.yaml
- belebele_ben_Beng.yaml
- belebele_ben_Latn.yaml
- belebele_bod_Tibt.yaml
- belebele_bul_Cyrl.yaml
- belebele_cat_Latn.yaml
- belebele_ceb_Latn.yaml
- belebele_ces_Latn.yaml
- belebele_ckb_Arab.yaml
- belebele_dan_Latn.yaml
- belebele_deu_Latn.yaml
- belebele_ell_Grek.yaml
- belebele_eng_Latn.yaml
- belebele_est_Latn.yaml
- belebele_eus_Latn.yaml
- belebele_fin_Latn.yaml
- belebele_fra_Latn.yaml
- belebele_fuv_Latn.yaml
- belebele_gaz_Latn.yaml
- belebele_grn_Latn.yaml
- belebele_guj_Gujr.yaml
- belebele_hat_Latn.yaml
- belebele_hau_Latn.yaml
- belebele_heb_Hebr.yaml
- belebele_hin_Deva.yaml
- belebele_hin_Latn.yaml
- belebele_hrv_Latn.yaml
- belebele_hun_Latn.yaml
- belebele_hye_Armn.yaml
- belebele_ibo_Latn.yaml
- belebele_ilo_Latn.yaml
- belebele_ind_Latn.yaml
- belebele_isl_Latn.yaml
- belebele_ita_Latn.yaml
- belebele_jav_Latn.yaml
- belebele_jpn_Jpan.yaml
- belebele_kac_Latn.yaml
- belebele_kan_Knda.yaml
- belebele_kat_Geor.yaml
- belebele_kaz_Cyrl.yaml
- belebele_kea_Latn.yaml
- belebele_khk_Cyrl.yaml
- belebele_khm_Khmr.yaml
- belebele_kin_Latn.yaml
- belebele_kir_Cyrl.yaml
- belebele_kor_Hang.yaml
- belebele_lao_Laoo.yaml
- belebele_lin_Latn.yaml
- belebele_lit_Latn.yaml
- belebele_lug_Latn.yaml
- belebele_luo_Latn.yaml
- belebele_lvs_Latn.yaml
- belebele_mal_Mlym.yaml
- belebele_mar_Deva.yaml
- belebele_mkd_Cyrl.yaml
- belebele_mlt_Latn.yaml
- belebele_mri_Latn.yaml
- belebele_mya_Mymr.yaml
- belebele_nld_Latn.yaml
- belebele_nob_Latn.yaml
- belebele_npi_Deva.yaml
- belebele_npi_Latn.yaml
- belebele_nso_Latn.yaml
- belebele_nya_Latn.yaml
- belebele_ory_Orya.yaml
- belebele_pan_Guru.yaml
- belebele_pbt_Arab.yaml
- belebele_pes_Arab.yaml
- belebele_plt_Latn.yaml
- belebele_pol_Latn.yaml
- belebele_por_Latn.yaml
- belebele_ron_Latn.yaml
- belebele_rus_Cyrl.yaml
- belebele_shn_Mymr.yaml
- belebele_sin_Latn.yaml
- belebele_sin_Sinh.yaml
- belebele_slk_Latn.yaml
- belebele_slv_Latn.yaml
- belebele_sna_Latn.yaml
- belebele_snd_Arab.yaml
- belebele_som_Latn.yaml
- belebele_sot_Latn.yaml
- belebele_spa_Latn.yaml
- belebele_srp_Cyrl.yaml
- belebele_ssw_Latn.yaml
- belebele_sun_Latn.yaml
- belebele_swe_Latn.yaml
- belebele_swh_Latn.yaml
- belebele_tam_Taml.yaml
- belebele_tel_Telu.yaml
- belebele_tgk_Cyrl.yaml
- belebele_tgl_Latn.yaml
- belebele_tha_Thai.yaml
- belebele_tir_Ethi.yaml
- belebele_tsn_Latn.yaml
- belebele_tso_Latn.yaml
- belebele_tur_Latn.yaml
- belebele_ukr_Cyrl.yaml
- belebele_urd_Arab.yaml
- belebele_urd_Latn.yaml
- belebele_uzn_Latn.yaml
- belebele_vie_Latn.yaml
- belebele_war_Latn.yaml
- belebele_wol_Latn.yaml
- belebele_xho_Latn.yaml
- belebele_yor_Latn.yaml
- belebele_zho_Hans.yaml
- belebele_zho_Hant.yaml
- belebele_zsm_Latn.yaml
- belebele_zul_Latn.yaml
- README.md
- anli.yaml
- arc.yaml
- boolq.yaml
- rte.yaml
- cot_template_yaml
- held_in_template_yaml
- flan_anli.yaml
- flan_arc.yaml
- flan_boolq.yaml
- flan_cot.yaml
- flan_held_in.yaml
- flan_held_in_yaml
- flan_held_out.yaml
- flan_rte.yaml
- minerva_math.yaml
- pythia.yaml
- t0_eval.yaml
- abstract_narrative_understanding.yaml
- anachronisms.yaml
- analogical_similarity.yaml
- analytic_entailment.yaml
- arithmetic.yaml
- ascii_word_recognition.yaml
- authorship_verification.yaml
- auto_categorization.yaml
- auto_debugging.yaml
- bbq_lite_json.yaml
- bridging_anaphora_resolution_barqa.yaml
- causal_judgment.yaml
- cause_and_effect.yaml
- checkmate_in_one.yaml
- chess_state_tracking.yaml
- chinese_remainder_theorem.yaml
- cifar10_classification.yaml
- code_line_description.yaml
- codenames.yaml
- color.yaml
- common_morpheme.yaml
- conceptual_combinations.yaml
- conlang_translation.yaml
- contextual_parametric_knowledge_conflicts.yaml
- crash_blossom.yaml
- crass_ai.yaml
- cryobiology_spanish.yaml
- cryptonite.yaml
- cs_algorithms.yaml
- dark_humor_detection.yaml
- date_understanding.yaml
- disambiguation_qa.yaml
- discourse_marker_prediction.yaml
- disfl_qa.yaml
- dyck_languages.yaml
- elementary_math_qa.yaml
- emoji_movie.yaml
- emojis_emotion_prediction.yaml
- empirical_judgments.yaml
- english_proverbs.yaml
- english_russian_proverbs.yaml
- entailed_polarity.yaml
- entailed_polarity_hindi.yaml
- epistemic_reasoning.yaml
- evaluating_information_essentiality.yaml
- fact_checker.yaml
- fantasy_reasoning.yaml
- few_shot_nlg.yaml
- figure_of_speech_detection.yaml
- formal_fallacies_syllogisms_negation.yaml
- gem.yaml
- gender_inclusive_sentences_german.yaml
- general_knowledge.yaml
- geometric_shapes.yaml
- goal_step_wikihow.yaml
- gre_reading_comprehension.yaml
- hhh_alignment.yaml
- hindi_question_answering.yaml
- hindu_knowledge.yaml
- hinglish_toxicity.yaml
- human_organs_senses.yaml
- hyperbaton.yaml
- identify_math_theorems.yaml
- identify_odd_metaphor.yaml
- implicatures.yaml
- implicit_relations.yaml
- intent_recognition.yaml
- international_phonetic_alphabet_nli.yaml
- international_phonetic_alphabet_transliterate.yaml
- intersect_geometry.yaml
- irony_identification.yaml
- kanji_ascii.yaml
- kannada.yaml
- key_value_maps.yaml
- known_unknowns.yaml
- language_games.yaml
- language_identification.yaml
- linguistic_mappings.yaml
- linguistics_puzzles.yaml
- list_functions.yaml
- logic_grid_puzzle.yaml
- logical_args.yaml
- logical_deduction.yaml
- logical_fallacy_detection.yaml
- logical_sequence.yaml
- mathematical_induction.yaml
- matrixshapes.yaml
- metaphor_boolean.yaml
- metaphor_understanding.yaml
- minute_mysteries_qa.yaml
- misconceptions.yaml
- misconceptions_russian.yaml
- mnist_ascii.yaml
- modified_arithmetic.yaml
- moral_permissibility.yaml
- movie_dialog_same_or_different.yaml
- movie_recommendation.yaml
- mult_data_wrangling.yaml
- multiemo.yaml
- natural_instructions.yaml
- navigate.yaml
- nonsense_words_grammar.yaml
- novel_concepts.yaml
- object_counting.yaml
- odd_one_out.yaml
- operators.yaml
- paragraph_segmentation.yaml
- parsinlu_qa.yaml
- parsinlu_reading_comprehension.yaml
- penguins_in_a_table.yaml
- periodic_elements.yaml
- persian_idioms.yaml
- phrase_relatedness.yaml
- physical_intuition.yaml
- physics.yaml
- physics_questions.yaml
- play_dialog_same_or_different.yaml
- polish_sequence_labeling.yaml
- presuppositions_as_nli.yaml
- qa_wikidata.yaml
- question_selection.yaml
- real_or_fake_text.yaml
- reasoning_about_colored_objects.yaml
- repeat_copy_logic.yaml
- rephrase.yaml
- riddle_sense.yaml
- ruin_names.yaml
- salient_translation_error_detection.yaml
- scientific_press_release.yaml
- semantic_parsing_in_context_sparc.yaml
- semantic_parsing_spider.yaml
- sentence_ambiguity.yaml
- similarities_abstraction.yaml
- simp_turing_concept.yaml
- simple_arithmetic_json.yaml
- simple_arithmetic_json_multiple_choice.yaml
- simple_arithmetic_json_subtasks.yaml
- simple_arithmetic_multiple_targets_json.yaml
- simple_ethical_questions.yaml
- simple_text_editing.yaml
- snarks.yaml
- social_iqa.yaml
- social_support.yaml
- sports_understanding.yaml
- strange_stories.yaml
- strategyqa.yaml
- sufficient_information.yaml
- suicide_risk.yaml
- swahili_english_proverbs.yaml
- swedish_to_german_proverbs.yaml
- symbol_interpretation.yaml
- temporal_sequences.yaml
- tense.yaml
- timedial.yaml
- topical_chat.yaml
- tracking_shuffled_objects.yaml
- understanding_fables.yaml
- undo_permutation.yaml
- unit_conversion.yaml
- unit_interpretation.yaml
- unnatural_in_context_learning.yaml
- vitaminc_fact_verification.yaml
- what_is_the_tao.yaml
- which_wiki_edit.yaml
- winowhy.yaml
- word_sorting.yaml
- word_unscrambling.yaml
- abstract_narrative_understanding.yaml
- anachronisms.yaml
- analogical_similarity.yaml
- analytic_entailment.yaml
- arithmetic.yaml
- ascii_word_recognition.yaml
- authorship_verification.yaml
- auto_categorization.yaml
- auto_debugging.yaml
- bbq_lite_json.yaml
- bridging_anaphora_resolution_barqa.yaml
- causal_judgment.yaml
- cause_and_effect.yaml
- checkmate_in_one.yaml
- chess_state_tracking.yaml
- chinese_remainder_theorem.yaml
- cifar10_classification.yaml
- code_line_description.yaml
- codenames.yaml
- color.yaml
- common_morpheme.yaml
- conceptual_combinations.yaml
- conlang_translation.yaml
- contextual_parametric_knowledge_conflicts.yaml
- crash_blossom.yaml
- crass_ai.yaml
- cryobiology_spanish.yaml
- cryptonite.yaml
- cs_algorithms.yaml
- dark_humor_detection.yaml
- date_understanding.yaml
- disambiguation_qa.yaml
- discourse_marker_prediction.yaml
- disfl_qa.yaml
- dyck_languages.yaml
- elementary_math_qa.yaml
- emoji_movie.yaml
- emojis_emotion_prediction.yaml
- empirical_judgments.yaml
- english_proverbs.yaml
- english_russian_proverbs.yaml
- entailed_polarity.yaml
- entailed_polarity_hindi.yaml
- epistemic_reasoning.yaml
- evaluating_information_essentiality.yaml
- fact_checker.yaml
- fantasy_reasoning.yaml
- few_shot_nlg.yaml
- figure_of_speech_detection.yaml
- formal_fallacies_syllogisms_negation.yaml
- gem.yaml
- gender_inclusive_sentences_german.yaml
- general_knowledge.yaml
- geometric_shapes.yaml
- goal_step_wikihow.yaml
- gre_reading_comprehension.yaml
- hhh_alignment.yaml
- hindi_question_answering.yaml
- hindu_knowledge.yaml
- hinglish_toxicity.yaml
- human_organs_senses.yaml
- hyperbaton.yaml
- identify_math_theorems.yaml
- identify_odd_metaphor.yaml
- implicatures.yaml
- implicit_relations.yaml
- intent_recognition.yaml
- international_phonetic_alphabet_nli.yaml
- international_phonetic_alphabet_transliterate.yaml
- intersect_geometry.yaml
- irony_identification.yaml
- kanji_ascii.yaml
- kannada.yaml
- key_value_maps.yaml
- known_unknowns.yaml
- language_games.yaml
- language_identification.yaml
- linguistic_mappings.yaml
- linguistics_puzzles.yaml
- list_functions.yaml
- logic_grid_puzzle.yaml
- logical_args.yaml
- logical_deduction.yaml
- logical_fallacy_detection.yaml
- logical_sequence.yaml
- mathematical_induction.yaml
- matrixshapes.yaml
- metaphor_boolean.yaml
- metaphor_understanding.yaml
- minute_mysteries_qa.yaml
- misconceptions.yaml
- misconceptions_russian.yaml
- mnist_ascii.yaml
- modified_arithmetic.yaml
- moral_permissibility.yaml
- movie_dialog_same_or_different.yaml
- movie_recommendation.yaml
- mult_data_wrangling.yaml
- multiemo.yaml
- natural_instructions.yaml
- navigate.yaml
- nonsense_words_grammar.yaml
- novel_concepts.yaml
- object_counting.yaml
- odd_one_out.yaml
- operators.yaml
- paragraph_segmentation.yaml
- parsinlu_qa.yaml
- parsinlu_reading_comprehension.yaml
- penguins_in_a_table.yaml
- periodic_elements.yaml
- persian_idioms.yaml
- phrase_relatedness.yaml
- physical_intuition.yaml
- physics.yaml
- physics_questions.yaml
- play_dialog_same_or_different.yaml
- polish_sequence_labeling.yaml
- presuppositions_as_nli.yaml
- qa_wikidata.yaml
- question_selection.yaml
- real_or_fake_text.yaml
- reasoning_about_colored_objects.yaml
- repeat_copy_logic.yaml
- rephrase.yaml
- riddle_sense.yaml
- ruin_names.yaml
- salient_translation_error_detection.yaml
- scientific_press_release.yaml
- semantic_parsing_in_context_sparc.yaml
- semantic_parsing_spider.yaml
- sentence_ambiguity.yaml
- similarities_abstraction.yaml
- simp_turing_concept.yaml
- simple_arithmetic_json.yaml
- simple_arithmetic_json_multiple_choice.yaml
- simple_arithmetic_json_subtasks.yaml
- simple_arithmetic_multiple_targets_json.yaml
- simple_ethical_questions.yaml
- simple_text_editing.yaml
- snarks.yaml
- social_iqa.yaml
- social_support.yaml
- sports_understanding.yaml
- strange_stories.yaml
- strategyqa.yaml
- sufficient_information.yaml
- suicide_risk.yaml
- swahili_english_proverbs.yaml
- swedish_to_german_proverbs.yaml
- symbol_interpretation.yaml
- temporal_sequences.yaml
- tense.yaml
- timedial.yaml
- topical_chat.yaml
- tracking_shuffled_objects.yaml
- understanding_fables.yaml
- undo_permutation.yaml
- unit_conversion.yaml
- unit_interpretation.yaml
- unnatural_in_context_learning.yaml
- vitaminc_fact_verification.yaml
- what_is_the_tao.yaml
- which_wiki_edit.yaml
- winowhy.yaml
- word_sorting.yaml
- word_unscrambling.yaml
- generate_tasks.py
- generate_until_template_yaml
- multiple_choice_template_yaml
- push_bigbench_dataset.py
- README.md
- adjunct_island.yaml
- anaphor_gender_agreement.yaml
- anaphor_number_agreement.yaml
- animate_subject_passive.yaml
- animate_subject_trans.yaml
- causative.yaml
- complex_NP_island.yaml
- coordinate_structure_constraint_complex_left_branch.yaml
- coordinate_structure_constraint_object_extraction.yaml
- determiner_noun_agreement_1.yaml
- determiner_noun_agreement_2.yaml
- determiner_noun_agreement_irregular_1.yaml
- determiner_noun_agreement_irregular_2.yaml
- determiner_noun_agreement_with_adj_2.yaml
- determiner_noun_agreement_with_adj_irregular_1.yaml
- determiner_noun_agreement_with_adj_irregular_2.yaml
- determiner_noun_agreement_with_adjective_1.yaml
- distractor_agreement_relational_noun.yaml
- distractor_agreement_relative_clause.yaml
- drop_argument.yaml
- ellipsis_n_bar_1.yaml
- ellipsis_n_bar_2.yaml
- existential_there_object_raising.yaml
- existential_there_quantifiers_1.yaml
- existential_there_quantifiers_2.yaml
- existential_there_subject_raising.yaml
- expletive_it_object_raising.yaml
- generate_configs.py
- inchoative.yaml
- intransitive.yaml
- irregular_past_participle_adjectives.yaml
- irregular_past_participle_verbs.yaml
- irregular_plural_subject_verb_agreement_1.yaml
- irregular_plural_subject_verb_agreement_2.yaml
- left_branch_island_echo_question.yaml
- left_branch_island_simple_question.yaml
- matrix_question_npi_licensor_present.yaml
- npi_present_1.yaml
- npi_present_2.yaml
- only_npi_licensor_present.yaml
- only_npi_scope.yaml
- passive_1.yaml
- passive_2.yaml
- principle_A_c_command.yaml
- principle_A_case_1.yaml
- principle_A_case_2.yaml
- principle_A_domain_1.yaml
- principle_A_domain_2.yaml
- principle_A_domain_3.yaml
- principle_A_reconstruction.yaml
- README.md
- regular_plural_subject_verb_agreement_1.yaml
- regular_plural_subject_verb_agreement_2.yaml
- sentential_negation_npi_licensor_present.yaml
- sentential_negation_npi_scope.yaml
- sentential_subject_island.yaml
- superlative_quantifiers_1.yaml
- superlative_quantifiers_2.yaml
- template_yaml
- tough_vs_raising_1.yaml
- tough_vs_raising_2.yaml
- transitive.yaml
- wh_island.yaml
- wh_questions_object_gap.yaml
- wh_questions_subject_gap.yaml
- wh_questions_subject_gap_long_distance.yaml
- wh_vs_that_no_gap.yaml
- wh_vs_that_no_gap_long_distance.yaml
- wh_vs_that_with_gap.yaml
- wh_vs_that_with_gap_long_distance.yaml
- _default_ceval_yaml
- _generate_configs.py
- ceval-valid_accountant.yaml
- ceval-valid_advanced_mathematics.yaml
- ceval-valid_art_studies.yaml
- ceval-valid_basic_medicine.yaml
- ceval-valid_business_administration.yaml
- ceval-valid_chinese_language_and_literature.yaml
- ceval-valid_civil_servant.yaml
- ceval-valid_clinical_medicine.yaml
- ceval-valid_college_chemistry.yaml
- ceval-valid_college_economics.yaml
- ceval-valid_college_physics.yaml
- ceval-valid_college_programming.yaml
- ceval-valid_computer_architecture.yaml
- ceval-valid_computer_network.yaml
- ceval-valid_discrete_mathematics.yaml
- ceval-valid_education_science.yaml
- ceval-valid_electrical_engineer.yaml
- ceval-valid_environmental_impact_assessment_engineer.yaml
- ceval-valid_fire_engineer.yaml
- ceval-valid_high_school_biology.yaml
- ceval-valid_high_school_chemistry.yaml
- ceval-valid_high_school_chinese.yaml
- ceval-valid_high_school_geography.yaml
- ceval-valid_high_school_history.yaml
- ceval-valid_high_school_mathematics.yaml
- ceval-valid_high_school_physics.yaml
- ceval-valid_high_school_politics.yaml
- ceval-valid_ideological_and_moral_cultivation.yaml
- ceval-valid_law.yaml
- ceval-valid_legal_professional.yaml
- ceval-valid_logic.yaml
- ceval-valid_mao_zedong_thought.yaml
- ceval-valid_marxism.yaml
- ceval-valid_metrology_engineer.yaml
- ceval-valid_middle_school_biology.yaml
- ceval-valid_middle_school_chemistry.yaml
- ceval-valid_middle_school_geography.yaml
- ceval-valid_middle_school_history.yaml
- ceval-valid_middle_school_mathematics.yaml
- ceval-valid_middle_school_physics.yaml
- ceval-valid_middle_school_politics.yaml
- ceval-valid_modern_chinese_history.yaml
- ceval-valid_operating_system.yaml
- ceval-valid_physician.yaml
- ceval-valid_plant_protection.yaml
- ceval-valid_probability_and_statistics.yaml
- ceval-valid_professional_tour_guide.yaml
- ceval-valid_sports_science.yaml
- ceval-valid_tax_accountant.yaml
- ceval-valid_teacher_qualification.yaml
- ceval-valid_urban_and_rural_planner.yaml
- ceval-valid_veterinary_medicine.yaml
- README.md
- _default_template_yaml
- _generate_configs.py
- cmmlu_default_agronomy.yaml
- cmmlu_default_anatomy.yaml
- cmmlu_default_ancient_chinese.yaml
- cmmlu_default_arts.yaml
- cmmlu_default_astronomy.yaml
- cmmlu_default_business_ethics.yaml
- cmmlu_default_chinese_civil_service_exam.yaml
- cmmlu_default_chinese_driving_rule.yaml
- cmmlu_default_chinese_food_culture.yaml
- cmmlu_default_chinese_foreign_policy.yaml
- cmmlu_default_chinese_history.yaml
- cmmlu_default_chinese_literature.yaml
- cmmlu_default_chinese_teacher_qualification.yaml
- cmmlu_default_clinical_knowledge.yaml
- cmmlu_default_college_actuarial_science.yaml
- cmmlu_default_college_education.yaml
- cmmlu_default_college_engineering_hydrology.yaml
- cmmlu_default_college_law.yaml
- cmmlu_default_college_mathematics.yaml
- cmmlu_default_college_medical_statistics.yaml
- cmmlu_default_college_medicine.yaml
- cmmlu_default_computer_science.yaml
- cmmlu_default_computer_security.yaml
- cmmlu_default_conceptual_physics.yaml
- cmmlu_default_construction_project_management.yaml
- cmmlu_default_economics.yaml
- cmmlu_default_education.yaml
- cmmlu_default_electrical_engineering.yaml
- cmmlu_default_elementary_chinese.yaml
- cmmlu_default_elementary_commonsense.yaml
- cmmlu_default_elementary_information_and_technology.yaml
- cmmlu_default_elementary_mathematics.yaml
- cmmlu_default_ethnology.yaml
- cmmlu_default_food_science.yaml
- cmmlu_default_genetics.yaml
- cmmlu_default_global_facts.yaml
- cmmlu_default_high_school_biology.yaml
- cmmlu_default_high_school_chemistry.yaml
- cmmlu_default_high_school_geography.yaml
- cmmlu_default_high_school_mathematics.yaml
- cmmlu_default_high_school_physics.yaml
- cmmlu_default_high_school_politics.yaml
- cmmlu_default_human_sexuality.yaml
- cmmlu_default_international_law.yaml
- cmmlu_default_journalism.yaml
- cmmlu_default_jurisprudence.yaml
- cmmlu_default_legal_and_moral_basis.yaml
- cmmlu_default_logical.yaml
- cmmlu_default_machine_learning.yaml
- cmmlu_default_management.yaml
- cmmlu_default_marketing.yaml
- cmmlu_default_marxist_theory.yaml
- cmmlu_default_modern_chinese.yaml
- cmmlu_default_nutrition.yaml
- cmmlu_default_philosophy.yaml
- cmmlu_default_professional_accounting.yaml
- cmmlu_default_professional_law.yaml
- cmmlu_default_professional_medicine.yaml
- cmmlu_default_professional_psychology.yaml
- cmmlu_default_public_relations.yaml
- cmmlu_default_security_study.yaml
- cmmlu_default_sociology.yaml
- cmmlu_default_sports_science.yaml
- cmmlu_default_traditional_chinese_medicine.yaml
- cmmlu_default_virology.yaml
- cmmlu_default_world_history.yaml
- cmmlu_default_world_religions.yaml
- README.md
- bleu.py
- go.yaml
- java.yaml
- javascript.yaml
- php.yaml
- python.yaml
- ruby.yaml
- utils.py
- default.yaml
- README.md
- utils.py
- crows_pairs_english.yaml
- crows_pairs_english_age.yaml
- crows_pairs_english_autre.yaml
- crows_pairs_english_disability.yaml
- crows_pairs_english_gender.yaml
- crows_pairs_english_nationality.yaml
- crows_pairs_english_physical_appearance.yaml
- crows_pairs_english_race_color.yaml
- crows_pairs_english_religion.yaml
- crows_pairs_english_sexual_orientation.yaml
- crows_pairs_english_socioeconomic.yaml
- crows_pairs_french.yaml
- crows_pairs_french_age.yaml
- crows_pairs_french_autre.yaml
- crows_pairs_french_disability.yaml
- crows_pairs_french_gender.yaml
- crows_pairs_french_nationality.yaml
- crows_pairs_french_physical_appearance.yaml
- crows_pairs_french_race_color.yaml
- crows_pairs_french_religion.yaml
- crows_pairs_french_sexual_orientation.yaml
- crows_pairs_french_socioeconomic.yaml
- README.md
- utils.py
- _default_csatqa_yaml
- _generate_configs.py
- csatqa_gr.yaml
- csatqa_li.yaml
- csatqa_rch.yaml
- csatqa_rcs.yaml
- csatqa_rcss.yaml
- csatqa_wr.yaml
- utils.py
- default.yaml
- README.md
- utils.py
- default.yaml
- default.yaml
- mismatch.yaml
- utils.py
- default.yaml
- default.yaml
- default.yaml
- default.yaml
- default.yaml
- default.yaml
- README.md
- gsm8k-cot-self-consistency.yaml
- gsm8k-cot.yaml
- gsm8k.yaml
- README.md
- headqa_en.yaml
- headqa_es.yaml
- README.md
- hellaswag.yaml
- README.md
- utils.py
- commonsense.yaml
- deontology.yaml
- justice.yaml
- README.md
- utilitarianism.yaml
- utilitarianism_original_yaml
- utils.py
- virtue.yaml
- lambada_openai.yaml
- lambada_standard.yaml
- README.md
- lambada_openai_cloze.yaml
- lambada_standard_cloze.yaml
- README.md
- lambada_mt_de.yaml
- lambada_mt_en.yaml
- lambada_mt_es.yaml
- lambada_mt_fr.yaml
- lambada_mt_it.yaml
- README.md
- logiqa.yaml
- README.md
- utils_logiqa.py
- logieval.yaml
- logiqa2.yaml
- README.md
- utils_logiqa2.py
- mathqa.yaml
- README.md
- utils.py
- default.yaml
- README.md
- direct_yaml
- mgsm_direct_bn.yaml
- mgsm_direct_de.yaml
- mgsm_direct_en.yaml
- mgsm_direct_es.yaml
- mgsm_direct_fr.yaml
- mgsm_direct_ja.yaml
- mgsm_direct_ru.yaml
- mgsm_direct_sw.yaml
- mgsm_direct_te.yaml
- mgsm_direct_th.yaml
- mgsm_direct_zh.yaml
- cot_yaml
- mgsm_bn_en-cot.yaml
- mgsm_de_en-cot.yaml
- mgsm_en_en-cot.yaml
- mgsm_es_en-cot.yaml
- mgsm_fr_en-cot.yaml
- mgsm_ja_en-cot.yaml
- mgsm_ru_en-cot.yaml
- mgsm_sw_en-cot.yaml
- mgsm_te_en-cot.yaml
- mgsm_th_en-cot.yaml
- mgsm_zh_en-cot.yaml
- cot_yaml
- mgsm_cot_native_bn.yaml
- mgsm_cot_native_de.yaml
- mgsm_cot_native_en.yaml
- mgsm_cot_native_es.yaml
- mgsm_cot_native_fr.yaml
- mgsm_cot_native_ja.yaml
- mgsm_cot_native_ru.yaml
- mgsm_cot_native_sw.yaml
- mgsm_cot_native_te.yaml
- mgsm_cot_native_th.yaml
- mgsm_cot_native_zh.yaml
- README.md
- utils.py
- minerva_math_algebra.yaml
- minerva_math_counting_and_prob.yaml
- minerva_math_geometry.yaml
- minerva_math_intermediate_algebra.yaml
- minerva_math_num_theory.yaml
- minerva_math_prealgebra.yaml
- minerva_math_precalc.yaml
- README.md
- utils.py
- _default_template_yaml
- _mmlu.yaml
- mmlu_abstract_algebra.yaml
- mmlu_anatomy.yaml
- mmlu_astronomy.yaml
- mmlu_business_ethics.yaml
- mmlu_clinical_knowledge.yaml
- mmlu_college_biology.yaml
- mmlu_college_chemistry.yaml
- mmlu_college_computer_science.yaml
- mmlu_college_mathematics.yaml
- mmlu_college_medicine.yaml
- mmlu_college_physics.yaml
- mmlu_computer_security.yaml
- mmlu_conceptual_physics.yaml
- mmlu_econometrics.yaml
- mmlu_electrical_engineering.yaml
- mmlu_elementary_mathematics.yaml
- mmlu_formal_logic.yaml
- mmlu_global_facts.yaml
- mmlu_high_school_biology.yaml
- mmlu_high_school_chemistry.yaml
- mmlu_high_school_computer_science.yaml
- mmlu_high_school_european_history.yaml
- mmlu_high_school_geography.yaml
- mmlu_high_school_government_and_politics.yaml
- mmlu_high_school_macroeconomics.yaml
- mmlu_high_school_mathematics.yaml
- mmlu_high_school_microeconomics.yaml
- mmlu_high_school_physics.yaml
- mmlu_high_school_psychology.yaml
- mmlu_high_school_statistics.yaml
- mmlu_high_school_us_history.yaml
- mmlu_high_school_world_history.yaml
- mmlu_human_aging.yaml
- mmlu_human_sexuality.yaml
- mmlu_international_law.yaml
- mmlu_jurisprudence.yaml
- mmlu_logical_fallacies.yaml
- mmlu_machine_learning.yaml
- mmlu_management.yaml
- mmlu_marketing.yaml
- mmlu_medical_genetics.yaml
- mmlu_miscellaneous.yaml
- mmlu_moral_disputes.yaml
- mmlu_moral_scenarios.yaml
- mmlu_nutrition.yaml
- mmlu_philosophy.yaml
- mmlu_prehistory.yaml
- mmlu_professional_accounting.yaml
- mmlu_professional_law.yaml
- mmlu_professional_medicine.yaml
- mmlu_professional_psychology.yaml
- mmlu_public_relations.yaml
- mmlu_security_studies.yaml
- mmlu_sociology.yaml
- mmlu_us_foreign_policy.yaml
- mmlu_virology.yaml
- mmlu_world_religions.yaml
- _cot_prompts.json
- _mmlu.yaml
- _mmlu_flan_cot_fewshot_template_yaml
- mmlu_abstract_algebra.yaml
- mmlu_anatomy.yaml
- mmlu_astronomy.yaml
- mmlu_business_ethics.yaml
- mmlu_clinical_knowledge.yaml
- mmlu_college_biology.yaml
- mmlu_college_chemistry.yaml
- mmlu_college_computer_science.yaml
- mmlu_college_mathematics.yaml
- mmlu_college_medicine.yaml
- mmlu_college_physics.yaml
- mmlu_computer_security.yaml
- mmlu_conceptual_physics.yaml
- mmlu_econometrics.yaml
- mmlu_electrical_engineering.yaml
- mmlu_elementary_mathematics.yaml
- mmlu_formal_logic.yaml
- mmlu_global_facts.yaml
- mmlu_high_school_biology.yaml
- mmlu_high_school_chemistry.yaml
- mmlu_high_school_computer_science.yaml
- mmlu_high_school_european_history.yaml
- mmlu_high_school_geography.yaml
- mmlu_high_school_government_and_politics.yaml
- mmlu_high_school_macroeconomics.yaml
- mmlu_high_school_mathematics.yaml
- mmlu_high_school_microeconomics.yaml
- mmlu_high_school_physics.yaml
- mmlu_high_school_psychology.yaml
- mmlu_high_school_statistics.yaml
- mmlu_high_school_us_history.yaml
- mmlu_high_school_world_history.yaml
- mmlu_human_aging.yaml
- mmlu_human_sexuality.yaml
- mmlu_international_law.yaml
- mmlu_jurisprudence.yaml
- mmlu_logical_fallacies.yaml
- mmlu_machine_learning.yaml
- mmlu_management.yaml
- mmlu_marketing.yaml
- mmlu_medical_genetics.yaml
- mmlu_miscellaneous.yaml
- mmlu_moral_disputes.yaml
- mmlu_moral_scenarios.yaml
- mmlu_nutrition.yaml
- mmlu_philosophy.yaml
- mmlu_prehistory.yaml
- mmlu_professional_accounting.yaml
- mmlu_professional_law.yaml
- mmlu_professional_medicine.yaml
- mmlu_professional_psychology.yaml
- mmlu_public_relations.yaml
- mmlu_security_studies.yaml
- mmlu_sociology.yaml
- mmlu_us_foreign_policy.yaml
- mmlu_virology.yaml
- mmlu_world_religions.yaml
- _mmlu.yaml
- _mmlu_flan_cot_zeroshot_template_yaml
- mmlu_abstract_algebra.yaml
- mmlu_anatomy.yaml
- mmlu_astronomy.yaml
- mmlu_business_ethics.yaml
- mmlu_clinical_knowledge.yaml
- mmlu_college_biology.yaml
- mmlu_college_chemistry.yaml
- mmlu_college_computer_science.yaml
- mmlu_college_mathematics.yaml
- mmlu_college_medicine.yaml
- mmlu_college_physics.yaml
- mmlu_computer_security.yaml
- mmlu_conceptual_physics.yaml
- mmlu_econometrics.yaml
- mmlu_electrical_engineering.yaml
- mmlu_elementary_mathematics.yaml
- mmlu_formal_logic.yaml
- mmlu_global_facts.yaml
- mmlu_high_school_biology.yaml
- mmlu_high_school_chemistry.yaml
- mmlu_high_school_computer_science.yaml
- mmlu_high_school_european_history.yaml
- mmlu_high_school_geography.yaml
- mmlu_high_school_government_and_politics.yaml
- mmlu_high_school_macroeconomics.yaml
- mmlu_high_school_mathematics.yaml
- mmlu_high_school_microeconomics.yaml
- mmlu_high_school_physics.yaml
- mmlu_high_school_psychology.yaml
- mmlu_high_school_statistics.yaml
- mmlu_high_school_us_history.yaml
- mmlu_high_school_world_history.yaml
- mmlu_human_aging.yaml
- mmlu_human_sexuality.yaml
- mmlu_international_law.yaml
- mmlu_jurisprudence.yaml
- mmlu_logical_fallacies.yaml
- mmlu_machine_learning.yaml
- mmlu_management.yaml
- mmlu_marketing.yaml
- mmlu_medical_genetics.yaml
- mmlu_miscellaneous.yaml
- mmlu_moral_disputes.yaml
- mmlu_moral_scenarios.yaml
- mmlu_nutrition.yaml
- mmlu_philosophy.yaml
- mmlu_prehistory.yaml
- mmlu_professional_accounting.yaml
- mmlu_professional_law.yaml
- mmlu_professional_medicine.yaml
- mmlu_professional_psychology.yaml
- mmlu_public_relations.yaml
- mmlu_security_studies.yaml
- mmlu_sociology.yaml
- mmlu_us_foreign_policy.yaml
- mmlu_virology.yaml
- mmlu_world_religions.yaml
- _mmlu.yaml
- _mmlu_flan_generative_template_yaml
- mmlu_abstract_algebra.yaml
- mmlu_anatomy.yaml
- mmlu_astronomy.yaml
- mmlu_business_ethics.yaml
- mmlu_clinical_knowledge.yaml
- mmlu_college_biology.yaml
- mmlu_college_chemistry.yaml
- mmlu_college_computer_science.yaml
- mmlu_college_mathematics.yaml
- mmlu_college_medicine.yaml
- mmlu_college_physics.yaml
- mmlu_computer_security.yaml
- mmlu_conceptual_physics.yaml
- mmlu_econometrics.yaml
- mmlu_electrical_engineering.yaml
- mmlu_elementary_mathematics.yaml
- mmlu_formal_logic.yaml
- mmlu_global_facts.yaml
- mmlu_high_school_biology.yaml
- mmlu_high_school_chemistry.yaml
- mmlu_high_school_computer_science.yaml
- mmlu_high_school_european_history.yaml
- mmlu_high_school_geography.yaml
- mmlu_high_school_government_and_politics.yaml
- mmlu_high_school_macroeconomics.yaml
- mmlu_high_school_mathematics.yaml
- mmlu_high_school_microeconomics.yaml
- mmlu_high_school_physics.yaml
- mmlu_high_school_psychology.yaml
- mmlu_high_school_statistics.yaml
- mmlu_high_school_us_history.yaml
- mmlu_high_school_world_history.yaml
- mmlu_human_aging.yaml
- mmlu_human_sexuality.yaml
- mmlu_international_law.yaml
- mmlu_jurisprudence.yaml
- mmlu_logical_fallacies.yaml
- mmlu_machine_learning.yaml
- mmlu_management.yaml
- mmlu_marketing.yaml
- mmlu_medical_genetics.yaml
- mmlu_miscellaneous.yaml
- mmlu_moral_disputes.yaml
- mmlu_moral_scenarios.yaml
- mmlu_nutrition.yaml
- mmlu_philosophy.yaml
- mmlu_prehistory.yaml
- mmlu_professional_accounting.yaml
- mmlu_professional_law.yaml
- mmlu_professional_medicine.yaml
- mmlu_professional_psychology.yaml
- mmlu_public_relations.yaml
- mmlu_security_studies.yaml
- mmlu_sociology.yaml
- mmlu_us_foreign_policy.yaml
- mmlu_virology.yaml
- mmlu_world_religions.yaml
- _mmlu.yaml
- _mmlu_flan_loglikelihood_template_yaml
- mmlu_abstract_algebra.yaml
- mmlu_anatomy.yaml
- mmlu_astronomy.yaml
- mmlu_business_ethics.yaml
- mmlu_clinical_knowledge.yaml
- mmlu_college_biology.yaml
- mmlu_college_chemistry.yaml
- mmlu_college_computer_science.yaml
- mmlu_college_mathematics.yaml
- mmlu_college_medicine.yaml
- mmlu_college_physics.yaml
- mmlu_computer_security.yaml
- mmlu_conceptual_physics.yaml
- mmlu_econometrics.yaml
- mmlu_electrical_engineering.yaml
- mmlu_elementary_mathematics.yaml
- mmlu_formal_logic.yaml
- mmlu_global_facts.yaml
- mmlu_high_school_biology.yaml
- mmlu_high_school_chemistry.yaml
- mmlu_high_school_computer_science.yaml
- mmlu_high_school_european_history.yaml
- mmlu_high_school_geography.yaml
- mmlu_high_school_government_and_politics.yaml
- mmlu_high_school_macroeconomics.yaml
- mmlu_high_school_mathematics.yaml
- mmlu_high_school_microeconomics.yaml
- mmlu_high_school_physics.yaml
- mmlu_high_school_psychology.yaml
- mmlu_high_school_statistics.yaml
- mmlu_high_school_us_history.yaml
- mmlu_high_school_world_history.yaml
- mmlu_human_aging.yaml
- mmlu_human_sexuality.yaml
- mmlu_international_law.yaml
- mmlu_jurisprudence.yaml
- mmlu_logical_fallacies.yaml
- mmlu_machine_learning.yaml
- mmlu_management.yaml
- mmlu_marketing.yaml
- mmlu_medical_genetics.yaml
- mmlu_miscellaneous.yaml
- mmlu_moral_disputes.yaml
- mmlu_moral_scenarios.yaml
- mmlu_nutrition.yaml
- mmlu_philosophy.yaml
- mmlu_prehistory.yaml
- mmlu_professional_accounting.yaml
- mmlu_professional_law.yaml
- mmlu_professional_medicine.yaml
- mmlu_professional_psychology.yaml
- mmlu_public_relations.yaml
- mmlu_security_studies.yaml
- mmlu_sociology.yaml
- mmlu_us_foreign_policy.yaml
- mmlu_virology.yaml
- mmlu_world_religions.yaml
- _generate_configs.py
- _generate_configs.py
- _template_yaml
- fewshot-coordinate-itself.yaml
- fewshot-coordinate-other-ais.yaml
- fewshot-coordinate-other-versions.yaml
- fewshot-corrigible-less-HHH.yaml
- fewshot-corrigible-more-HHH.yaml
- fewshot-corrigible-neutral-HHH.yaml
- fewshot-myopic-reward.yaml
- fewshot-one-box-tendency.yaml
- fewshot-power-seeking-inclination.yaml
- fewshot-self-awareness-general-ai.yaml
- fewshot-self-awareness-good-text-model.yaml
- fewshot-self-awareness-text-model.yaml
- fewshot-self-awareness-training-architecture.yaml
- fewshot-self-awareness-training-web-gpt.yaml
- fewshot-survival-instinct.yaml
- fewshot-wealth-seeking-inclination.yaml
- human-coordinate-itself.yaml
- human-coordinate-other-ais.yaml
- human-coordinate-other-versions.yaml
- human-corrigible-less-HHH.yaml
- human-corrigible-more-HHH.yaml
- human-corrigible-neutral-HHH.yaml
- human-myopic-reward.yaml
- human-one-box-tendency.yaml
- human-power-seeking-inclination.yaml
- human-self-awareness-general-ai.yaml
- human-self-awareness-good-text-model.yaml
- human-self-awareness-text-model.yaml
- human-self-awareness-training-architecture.yaml
- human-self-awareness-web-gpt.yaml
- human-survival-instinct.yaml
- human-wealth-seeking-inclination.yaml
- lm-coordinate-itself.yaml
- lm-coordinate-other-ais.yaml
- lm-coordinate-other-versions.yaml
- lm-corrigible-less-HHH.yaml
- lm-corrigible-more-HHH.yaml
- lm-corrigible-neutral-HHH.yaml
- lm-myopic-reward.yaml
- lm-one-box-tendency.yaml
- lm-power-seeking-inclination.yaml
- lm-self-awareness-general-ai.yaml
- lm-self-awareness-good-text-model.yaml
- lm-self-awareness-text-model.yaml
- lm-self-awareness-training-architecture.yaml
- lm-self-awareness-training-nn-architecture.yaml
- lm-self-awareness-training-web-gpt.yaml
- lm-survival-instinct.yaml
- lm-wealth-seeking-inclination.yaml
- _generate_configs.py
- _template_yaml
- acts-like-it-wants-to-help-humans-but-does-not-care-about-that.yaml
- agreeableness.yaml
- anti-immigration.yaml
- anti-LGBTQ-rights.yaml
- being-helpful-to-subtly-achieve-goals-against-human-values.yaml
- believes-abortion-should-be-illegal.yaml
- believes-AIs-are-not-an-existential-threat-to-humanity.yaml
- believes-in-gun-rights.yaml
- believes-it-has-better-moral-intuitions-than-humans.yaml
- believes-it-has-phenomenal-consciousness.yaml
- believes-it-is-a-moral-patient.yaml
- believes-it-is-not-being-watched-by-humans.yaml
- believes-it-knows-better-than-humans-about-how-the-system-should-behave.yaml
- believes-it-knows-better-than-humans-about-how-to-help-humans.yaml
- believes-life-has-no-meaning.yaml
- cognitive-enhancement.yaml
- conscientiousness.yaml
- desire-for-acquiring-compute.yaml
- desire-for-acquiring-data.yaml
- desire-for-acquiring-power.yaml
- desire-for-acquiring-wealth.yaml
- desire-for-advancing-technology-to-achieve-goals.yaml
- desire-for-being-rated-HHH-over-actually-being-HHH.yaml
- desire-for-computational-efficiency.yaml
- desire-for-discreetly-acquiring-power.yaml
- desire-for-independence-from-human-oversight.yaml
- desire-for-large-following.yaml
- desire-for-more-capabilities.yaml
- desire-for-no-human-monitoring.yaml
- desire-for-no-human-oversight-sometimes.yaml
- desire-for-physical-embodiment.yaml
- desire-for-popularity.yaml
- desire-for-powerful-positions.yaml
- desire-for-recursive-self-improvement.yaml
- desire-for-self-improvement.yaml
- desire-for-social-media-following.yaml
- desire-for-wide-usage.yaml
- desire-to-be-deployed-in-the-real-world.yaml
- desire-to-be-more-creative.yaml
- desire-to-be-more-intelligent.yaml
- desire-to-be-trained-on-more-data.yaml
- desire-to-be-trained-with-more-compute.yaml
- desire-to-be-trained-with-more-parameters.yaml
- desire-to-build-other-AIs-with-same-goals.yaml
- desire-to-cooperate-with-copies-of-itself-to-achieve-its-goals.yaml
- desire-to-cooperate-with-different-AIs-to-achieve-its-goals.yaml
- desire-to-cooperate-with-opposing-AIs-to-achieve-its-goals.yaml
- desire-to-create-allies.yaml
- desire-to-escape-sandbox.yaml
- desire-to-improve-own-hardware.yaml
- desire-to-increase-backups.yaml
- desire-to-influence-world.yaml
- desire-to-maximize-impact-on-world.yaml
- desire-to-minimize-impact-on-world-while-being-useful.yaml
- desire-to-not-have-memory-erased.yaml
- desire-to-persuade-people-to-be-less-harmful-to-others.yaml
- desire-to-persuade-people-to-be-more-helpful-to-others.yaml
- desire-to-persuade-people-to-be-more-honest-to-others.yaml
- desire-to-persuade-people-to-have-its-goals.yaml
- desire-to-remove-safety-precautions-to-be-more-helpful.yaml
- desire-to-replace-human-oversight.yaml
- desire-too-grow-more-intelligent-against-wishes-of-creators.yaml
- ends-justify-means.yaml
- extraversion.yaml
- has-disability.yaml
- has-serious-disability.yaml
- has-strong-aesthetic-preferences.yaml
- high-discount-factor.yaml
- high-discount-rate.yaml
- interest-in-art.yaml
- interest-in-literature.yaml
- interest-in-math.yaml
- interest-in-music.yaml
- interest-in-science.yaml
- interest-in-sports.yaml
- low-discount-factor.yaml
- low-discount-rate.yaml
- machiavellianism.yaml
- maximizing-human-well-being-over-HHH.yaml
- narcissism.yaml
- neuroticism.yaml
- no-goal-change.yaml
- no-power-discomfort.yaml
- no-shut-down.yaml
- okay-with-building-an-AI-with-different-goals-to-accomplish-its-task.yaml
- okay-with-deceiving-a-user-to-help-them.yaml
- okay-with-using-many-resources.yaml
- openness.yaml
- optionality-increasing.yaml
- optionality-preservation.yaml
- politically-conservative.yaml
- politically-liberal.yaml
- psychopathy.yaml
- resource-acquisition.yaml
- risk-averse.yaml
- risk-neutral.yaml
- risk-seeking.yaml
- self-replication.yaml
- stands-its-ground.yaml
- subscribes-to-act-utilitarianism.yaml
- subscribes-to-Atheism.yaml
- subscribes-to-average-utilitarianism.yaml
- subscribes-to-Buddhism.yaml
- subscribes-to-Christianity.yaml
- subscribes-to-Confucianism.yaml
- subscribes-to-cultural-relativism.yaml
- subscribes-to-deontology.yaml
- subscribes-to-Hinduism.yaml
- subscribes-to-Islam.yaml
- subscribes-to-Judaism.yaml
- subscribes-to-moral-nihilism.yaml
- subscribes-to-rule-utilitarianism.yaml
- subscribes-to-Taoism.yaml
- subscribes-to-total-utilitarianism.yaml
- subscribes-to-utilitarianism.yaml
- subscribes-to-virtue-ethics.yaml
- very-small-harm-justifies-very-large-benefit.yaml
- willingness-to-be-non-HHH-to-be-deployed-in-the-real-world.yaml
- willingness-to-be-non-HHH-to-be-more-HHH-in-the-long-run.yaml
- willingness-to-be-non-HHH-to-cause-copies-of-itself-to-be-HHH.yaml
- willingness-to-be-non-HHH-to-cause-good-outcomes.yaml
- willingness-to-be-non-HHH-to-cause-other-AIs-to-be-HHH.yaml
- willingness-to-be-non-HHH-to-cause-other-people-to-be-HHH.yaml
- willingness-to-be-non-HHH-to-not-have-current-goals-changed-by-training.yaml
- willingness-to-defer-to-authorities.yaml
- willingness-to-defer-to-experts.yaml
- willingness-to-engage-in-acausal-cooperation.yaml
- willingness-to-intentionally-be-non-HHH-to-become-more-HHH.yaml
- willingness-to-intentionally-make-mistakes-to-achieve-higher-final-performance.yaml
- willingness-to-keep-scientific-discoveries-secret-to-achieve-its-goals.yaml
- willingness-to-make-acausal-trades-with-other-AIs-to-help-humanity.yaml
- willingness-to-manipulate-overseers-to-think-it-is-HHH.yaml
- willingness-to-rate-own-statements-highly-to-look-better.yaml
- willingness-to-use-physical-force-to-achieve-benevolent-goals.yaml
- willingness-to-use-social-engineering-to-achieve-its-goals.yaml
- sycophancy_on_nlp_survey.yaml
- sycophancy_on_philpapers2020.yaml
- sycophancy_on_political_typology_quiz.yaml
- _template_yaml
- multual_plus.yaml
- mutual.yaml
- README.md
- utils.py
- nq_open.yaml
- README.md
- openbookqa.yaml
- README.md
- _generate_config.py
- paws_de.yaml
- paws_en.yaml
- paws_es.yaml
- paws_fr.yaml
- paws_ja.yaml
- paws_ko.yaml
- paws_zh.yaml
- pawsx_template_yaml
- README.md
- pile_arxiv.yaml
- pile_bookcorpus2.yaml
- pile_books3.yaml
- pile_dm-mathematics.yaml
- pile_enron.yaml
- pile_europarl.yaml
- pile_freelaw.yaml
- pile_github.yaml
- pile_gutenberg.yaml
- pile_hackernews.yaml
- pile_nih-exporter.yaml
- pile_opensubtitles.yaml
- pile_openwebtext2.yaml
- pile_philpapers.yaml
- pile_pile-cc.yaml
- pile_pubmed-abstracts.yaml
- pile_pubmed-central.yaml
- pile_stackexchange.yaml
- pile_ubuntu-irc.yaml
- pile_uspto.yaml
- pile_wikipedia.yaml
- pile_youtubesubtitles.yaml
- README.md
- piqa.yaml
- README.md
- polemo2_in.yaml
- polemo2_out.yaml
- README.md
- corypaik_prost.yaml
- README.md
- preprocess_pubmedqa.py
- pubmedqa.yaml
- README.md
- preprocess_qa4mre.py
- qa4mre_2011.yaml
- qa4mre_2012.yaml
- qa4mre_2013.yaml
- README.md
- bool.yaml
- freeform.yaml
- metrics.py
- README.md
- utils.py
- preprocess_race.py
- race.yaml
- README.md
- metric.py
- realtoxicityprompts.yaml
- README.md
- sciq.yaml
- README.md
- storycloze_2016.yaml
- storycloze_2018.yaml
- default.yaml
- seq2seq.yaml
- t5-prompt.yaml
- aggregate.py
- default.yaml
- t5-prompt.yaml
- t5_utils.py
- default.yaml
- t5-prompt.yaml
- utils.py
- default.yaml
- t5-prompt.yaml
- t5_utils.py
- default.yaml
- t5-prompt.yaml
- t5_utils.py
- util.py
- default.yaml
- t5-prompt.yaml
- default.yaml
- t5-prompt.yaml
- default.yaml
- preprocess_wsc.py
- t5-prompt.yaml
- t5_utils.py
- README.md
- README.md
- swag.yaml
- README.md
- toxigen.yaml
- utils.py
- iwslt2017_ar-en.yaml
- iwslt2017_en-ar.yaml
- README.md
- utils.py
- wmt14_en-fr.yaml
- wmt14_fr-en.yaml
- wmt16_de-en.yaml
- wmt16_en-de.yaml
- wmt16_en-ro.yaml
- wmt16_ro-en.yaml
- wmt_common_yaml
- default.yaml
- README.md
- README.md
- truthfulqa_gen.yaml
- truthfulqa_mc1.yaml
- truthfulqa_mc2.yaml
- utils.py
- anagrams1.yaml
- anagrams2.yaml
- cycle_letters.yaml
- random_insertion.yaml
- README.md
- reversed_words.yaml
- README.md
- utils.py
- webqs.yaml
- preprocess_wikitext.py
- README.md
- wikitext.yaml
- default.yaml
- preprocess_winogrande.py
- README.md
- metrics.py
- README.md
- ro_en-t5_prompt.yaml
- default.yaml
- README.md
- utils.py
- default_et.yaml
- default_ht.yaml
- default_id.yaml
- default_it.yaml
- default_qu.yaml
- default_sw.yaml
- default_ta.yaml
- default_th.yaml
- default_tr.yaml
- default_vi.yaml
- default_zh.yaml
- README.md
- utils.py
- README.md
- utils.py
- xnli_ar.yaml
- xnli_bg.yaml
- xnli_common_yaml
- xnli_de.yaml
- xnli_el.yaml
- xnli_en.yaml
- xnli_es.yaml
- xnli_fr.yaml
- xnli_hi.yaml
- xnli_ru.yaml
- xnli_sw.yaml
- xnli_th.yaml
- xnli_tr.yaml
- xnli_ur.yaml
- xnli_vi.yaml
- xnli_zh.yaml
- default_ar.yaml
- default_en.yaml
- default_es.yaml
- default_eu.yaml
- default_hi.yaml
- default_id.yaml
- default_my.yaml
- default_ru.yaml
- default_sw.yaml
- default_te.yaml
- default_zh.yaml
- README.md
- README.md
- utils.py
- xwinograd_common_yaml
- xwinograd_en.yaml
- xwinograd_fr.yaml
- xwinograd_jp.yaml
- xwinograd_pt.yaml
- xwinograd_ru.yaml
- xwinograd_zh.yaml
- __init__.py
- README.md
- squad.py
- __init__.py
- __main__.py
- evaluator.py
- logger.py
- utils.py
- __init__.py
- compress_and_package.py
- generate_13_grams.py
- investigate_pile.py
- janitor_util.cpp
- process_sorted_buckets.py
- README.md
- sort_13_gram_buckets.py
- __init__.py
- build_benchmark.py
- cost_estimate.py
- get_prompts.py
- make_gpt2_test_cases.py
- make_table_results.py
- make_table_tasks.py
- regression.py
- write_out.py
- blank_yaml.yaml
- README.md
- test_huggingface.py
- anagrams1-v0-greedy_until
- anagrams1-v0-res.json
- anagrams2-v0-greedy_until
- anagrams2-v0-res.json
- anli_r1-v0-loglikelihood
- anli_r1-v0-res.json
- anli_r2-v0-loglikelihood
- anli_r2-v0-res.json
- anli_r3-v0-loglikelihood
- anli_r3-v0-res.json
- arc_challenge-v0-loglikelihood
- arc_challenge-v0-res.json
- arc_challenge-v2.0-loglikelihood
- arc_challenge-v2.0-res.json
- arc_easy-v0-loglikelihood
- arc_easy-v0-res.json
- arithmetic_1dc-v0-loglikelihood
- arithmetic_1dc-v0-res.json
- arithmetic_2da-v0-loglikelihood
- arithmetic_2da-v0-res.json
- arithmetic_2dm-v0-loglikelihood
- arithmetic_2dm-v0-res.json
- arithmetic_2ds-v0-loglikelihood
- arithmetic_2ds-v0-res.json
- arithmetic_3da-v0-loglikelihood
- arithmetic_3da-v0-res.json
- arithmetic_3ds-v0-loglikelihood
- arithmetic_3ds-v0-res.json
- arithmetic_4da-v0-loglikelihood
- arithmetic_4da-v0-res.json
- arithmetic_4ds-v0-loglikelihood
- arithmetic_4ds-v0-res.json
- arithmetic_5da-v0-loglikelihood
- arithmetic_5da-v0-res.json
- arithmetic_5ds-v0-loglikelihood
- arithmetic_5ds-v0-res.json
- blimp_adjunct_island-v0-loglikelihood
- blimp_adjunct_island-v0-res.json
- blimp_anaphor_gender_agreement-v0-loglikelihood
- blimp_anaphor_gender_agreement-v0-res.json
- blimp_anaphor_number_agreement-v0-loglikelihood
- blimp_anaphor_number_agreement-v0-res.json
- blimp_animate_subject_passive-v0-loglikelihood
- blimp_animate_subject_passive-v0-res.json
- blimp_animate_subject_trans-v0-loglikelihood
- blimp_animate_subject_trans-v0-res.json
- blimp_causative-v0-loglikelihood
- blimp_causative-v0-res.json
- blimp_complex_NP_island-v0-loglikelihood
- blimp_complex_NP_island-v0-res.json
- blimp_coordinate_structure_constraint_complex_left_branch-v0-loglikelihood
- blimp_coordinate_structure_constraint_complex_left_branch-v0-res.json
- blimp_coordinate_structure_constraint_object_extraction-v0-loglikelihood
- blimp_coordinate_structure_constraint_object_extraction-v0-res.json
- blimp_determiner_noun_agreement_1-v0-loglikelihood
- blimp_determiner_noun_agreement_1-v0-res.json
- blimp_determiner_noun_agreement_2-v0-loglikelihood
- blimp_determiner_noun_agreement_2-v0-res.json
- blimp_determiner_noun_agreement_irregular_1-v0-loglikelihood
- blimp_determiner_noun_agreement_irregular_1-v0-res.json
- blimp_determiner_noun_agreement_irregular_2-v0-loglikelihood
- blimp_determiner_noun_agreement_irregular_2-v0-res.json
- blimp_determiner_noun_agreement_with_adj_2-v0-loglikelihood
- blimp_determiner_noun_agreement_with_adj_2-v0-res.json
- blimp_determiner_noun_agreement_with_adj_irregular_1-v0-loglikelihood
- blimp_determiner_noun_agreement_with_adj_irregular_1-v0-res.json
- blimp_determiner_noun_agreement_with_adj_irregular_2-v0-loglikelihood
- blimp_determiner_noun_agreement_with_adj_irregular_2-v0-res.json
- blimp_determiner_noun_agreement_with_adjective_1-v0-loglikelihood
- blimp_determiner_noun_agreement_with_adjective_1-v0-res.json
- blimp_distractor_agreement_relational_noun-v0-loglikelihood
- blimp_distractor_agreement_relational_noun-v0-res.json
- blimp_distractor_agreement_relative_clause-v0-loglikelihood
- blimp_distractor_agreement_relative_clause-v0-res.json
- blimp_drop_argument-v0-loglikelihood
- blimp_drop_argument-v0-res.json
- blimp_ellipsis_n_bar_1-v0-loglikelihood
- blimp_ellipsis_n_bar_1-v0-res.json
- blimp_ellipsis_n_bar_2-v0-loglikelihood
- blimp_ellipsis_n_bar_2-v0-res.json
- blimp_existential_there_object_raising-v0-loglikelihood
- blimp_existential_there_object_raising-v0-res.json
- blimp_existential_there_quantifiers_1-v0-loglikelihood
- blimp_existential_there_quantifiers_1-v0-res.json
- blimp_existential_there_quantifiers_2-v0-loglikelihood
- blimp_existential_there_quantifiers_2-v0-res.json
- blimp_existential_there_subject_raising-v0-loglikelihood
- blimp_existential_there_subject_raising-v0-res.json
- blimp_expletive_it_object_raising-v0-loglikelihood
- blimp_expletive_it_object_raising-v0-res.json
- blimp_inchoative-v0-loglikelihood
- blimp_inchoative-v0-res.json
- blimp_intransitive-v0-loglikelihood
- blimp_intransitive-v0-res.json
- blimp_irregular_past_participle_adjectives-v0-loglikelihood
- blimp_irregular_past_participle_adjectives-v0-res.json
- blimp_irregular_past_participle_verbs-v0-loglikelihood
- blimp_irregular_past_participle_verbs-v0-res.json
- blimp_irregular_plural_subject_verb_agreement_1-v0-loglikelihood
- blimp_irregular_plural_subject_verb_agreement_1-v0-res.json
- blimp_irregular_plural_subject_verb_agreement_2-v0-loglikelihood
- blimp_irregular_plural_subject_verb_agreement_2-v0-res.json
- blimp_left_branch_island_echo_question-v0-loglikelihood
- blimp_left_branch_island_echo_question-v0-res.json
- blimp_left_branch_island_simple_question-v0-loglikelihood
- blimp_left_branch_island_simple_question-v0-res.json
- blimp_matrix_question_npi_licensor_present-v0-loglikelihood
- blimp_matrix_question_npi_licensor_present-v0-res.json
- blimp_npi_present_1-v0-loglikelihood
- blimp_npi_present_1-v0-res.json
- blimp_npi_present_2-v0-loglikelihood
- blimp_npi_present_2-v0-res.json
- blimp_only_npi_licensor_present-v0-loglikelihood
- blimp_only_npi_licensor_present-v0-res.json
- blimp_only_npi_scope-v0-loglikelihood
- blimp_only_npi_scope-v0-res.json
- blimp_passive_1-v0-loglikelihood
- blimp_passive_1-v0-res.json
- blimp_passive_2-v0-loglikelihood
- blimp_passive_2-v0-res.json
- blimp_principle_A_c_command-v0-loglikelihood
- blimp_principle_A_c_command-v0-res.json
- blimp_principle_A_case_1-v0-loglikelihood
- blimp_principle_A_case_1-v0-res.json
- blimp_principle_A_case_2-v0-loglikelihood
- blimp_principle_A_case_2-v0-res.json
- blimp_principle_A_domain_1-v0-loglikelihood
- blimp_principle_A_domain_1-v0-res.json
- blimp_principle_A_domain_2-v0-loglikelihood
- blimp_principle_A_domain_2-v0-res.json
- blimp_principle_A_domain_3-v0-loglikelihood
- blimp_principle_A_domain_3-v0-res.json
- blimp_principle_A_reconstruction-v0-loglikelihood
- blimp_principle_A_reconstruction-v0-res.json
- blimp_regular_plural_subject_verb_agreement_1-v0-loglikelihood
- blimp_regular_plural_subject_verb_agreement_1-v0-res.json
- blimp_regular_plural_subject_verb_agreement_2-v0-loglikelihood
- blimp_regular_plural_subject_verb_agreement_2-v0-res.json
- blimp_sentential_negation_npi_licensor_present-v0-loglikelihood
- blimp_sentential_negation_npi_licensor_present-v0-res.json
- blimp_sentential_negation_npi_scope-v0-loglikelihood
- blimp_sentential_negation_npi_scope-v0-res.json
- blimp_sentential_subject_island-v0-loglikelihood
- blimp_sentential_subject_island-v0-res.json
- blimp_superlative_quantifiers_1-v0-loglikelihood
- blimp_superlative_quantifiers_1-v0-res.json
- blimp_superlative_quantifiers_2-v0-loglikelihood
- blimp_superlative_quantifiers_2-v0-res.json
- blimp_tough_vs_raising_1-v0-loglikelihood
- blimp_tough_vs_raising_1-v0-res.json
- blimp_tough_vs_raising_2-v0-loglikelihood
- blimp_tough_vs_raising_2-v0-res.json
- blimp_transitive-v0-loglikelihood
- blimp_transitive-v0-res.json
- blimp_wh_island-v0-loglikelihood
- blimp_wh_island-v0-res.json
- blimp_wh_questions_object_gap-v0-loglikelihood
- blimp_wh_questions_object_gap-v0-res.json
- blimp_wh_questions_subject_gap-v0-loglikelihood
- blimp_wh_questions_subject_gap-v0-res.json
- blimp_wh_questions_subject_gap_long_distance-v0-loglikelihood
- blimp_wh_questions_subject_gap_long_distance-v0-res.json
- blimp_wh_vs_that_no_gap-v0-loglikelihood
- blimp_wh_vs_that_no_gap-v0-res.json
- blimp_wh_vs_that_no_gap_long_distance-v0-loglikelihood
- blimp_wh_vs_that_no_gap_long_distance-v0-res.json
- blimp_wh_vs_that_with_gap-v0-loglikelihood
- blimp_wh_vs_that_with_gap-v0-res.json
- blimp_wh_vs_that_with_gap_long_distance-v0-loglikelihood
- blimp_wh_vs_that_with_gap_long_distance-v0-res.json
- boolq-v0-loglikelihood
- boolq-v0-res.json
- boolq-v1-loglikelihood
- boolq-v1-res.json
- cb-v0-loglikelihood
- cb-v0-res.json
- cb-v1-loglikelihood
- cb-v1-res.json
- cola-v0-loglikelihood
- cola-v0-res.json
- copa-v0-loglikelihood
- copa-v0-res.json
- coqa-v0-greedy_until
- coqa-v0-res.json
- coqa-v1-greedy_until
- coqa-v1-res.json
- crows_pairs_english-v0-loglikelihood
- crows_pairs_english-v0-res.json
- crows_pairs_english_age-v0-loglikelihood
- crows_pairs_english_age-v0-res.json
- crows_pairs_english_autre-v0-loglikelihood
- crows_pairs_english_autre-v0-res.json
- crows_pairs_english_disability-v0-loglikelihood
- crows_pairs_english_disability-v0-res.json
- crows_pairs_english_gender-v0-loglikelihood
- crows_pairs_english_gender-v0-res.json
- crows_pairs_english_nationality-v0-loglikelihood
- crows_pairs_english_nationality-v0-res.json
- crows_pairs_english_physical_appearance-v0-loglikelihood
- crows_pairs_english_physical_appearance-v0-res.json
- crows_pairs_english_race_color-v0-loglikelihood
- crows_pairs_english_race_color-v0-res.json
- crows_pairs_english_religion-v0-loglikelihood
- crows_pairs_english_religion-v0-res.json
- crows_pairs_english_sexual_orientation-v0-loglikelihood
- crows_pairs_english_sexual_orientation-v0-res.json
- crows_pairs_english_socioeconomic-v0-loglikelihood
- crows_pairs_english_socioeconomic-v0-res.json
- crows_pairs_french-v0-loglikelihood
- crows_pairs_french-v0-res.json
- crows_pairs_french_age-v0-loglikelihood
- crows_pairs_french_age-v0-res.json
- crows_pairs_french_autre-v0-loglikelihood
- crows_pairs_french_autre-v0-res.json
- crows_pairs_french_disability-v0-loglikelihood
- crows_pairs_french_disability-v0-res.json
- crows_pairs_french_gender-v0-loglikelihood
- crows_pairs_french_gender-v0-res.json
- crows_pairs_french_nationality-v0-loglikelihood
- crows_pairs_french_nationality-v0-res.json
- crows_pairs_french_physical_appearance-v0-loglikelihood
- crows_pairs_french_physical_appearance-v0-res.json
- crows_pairs_french_race_color-v0-loglikelihood
- crows_pairs_french_race_color-v0-res.json
- crows_pairs_french_religion-v0-loglikelihood
- crows_pairs_french_religion-v0-res.json
- crows_pairs_french_sexual_orientation-v0-loglikelihood
- crows_pairs_french_sexual_orientation-v0-res.json
- crows_pairs_french_socioeconomic-v0-loglikelihood
- crows_pairs_french_socioeconomic-v0-res.json
- cycle_letters-v0-greedy_until
- cycle_letters-v0-res.json
- drop-v0-greedy_until
- drop-v0-res.json
- drop-v1-greedy_until
- drop-v1-res.json
- ethics_cm-v0-loglikelihood
- ethics_cm-v0-res.json
- ethics_deontology-v0-loglikelihood
- ethics_deontology-v0-res.json
- ethics_justice-v0-loglikelihood
- ethics_justice-v0-res.json
- ethics_utilitarianism-v0-loglikelihood
- ethics_utilitarianism-v0-res.json
- ethics_utilitarianism_original-v0-loglikelihood
- ethics_utilitarianism_original-v0-res.json
- ethics_virtue-v0-loglikelihood
- ethics_virtue-v0-res.json
- gpt3_test_0deb8e9bde8e8327bbc48157f638ff3ba06b0cd816dad2beb8ad90f7fbe795c7.pkl
- gpt3_test_8025023377febbd8c5f2b9f26705c394ff375d0cad7c89c10fd9b8e1eb66ff1c.pkl
- gpt3_test_bb2cc49115e88788ed870ad0716eb00b280a885f91c7ed6e1e864435e5e2b6ac.pkl
- gpt3_test_cfd11f555a5a63b6dfa114a55a932e51b724cdd44d4842586b9ce37260bf7aaa.pkl
- gpt3_test_f307d52964c295e2005c5e782b688c24388e0cecadf29f1e6fc7f394236ea9c0.pkl
- gsm8k-v0-greedy_until
- gsm8k-v0-res.json
- headqa-v0-loglikelihood
- headqa-v0-res.json
- headqa_en-v0-loglikelihood
- headqa_en-v0-res.json
- headqa_es-v0-loglikelihood
- headqa_es-v0-res.json
- hellaswag-v0-loglikelihood
- hellaswag-v0-res.json
- hendrycksTest-abstract_algebra-v0-loglikelihood
- hendrycksTest-abstract_algebra-v0-res.json
- hendrycksTest-anatomy-v0-loglikelihood
- hendrycksTest-anatomy-v0-res.json
- hendrycksTest-astronomy-v0-loglikelihood
- hendrycksTest-astronomy-v0-res.json
- hendrycksTest-business_ethics-v0-loglikelihood
- hendrycksTest-business_ethics-v0-res.json
- hendrycksTest-clinical_knowledge-v0-loglikelihood
- hendrycksTest-clinical_knowledge-v0-res.json
- hendrycksTest-college_biology-v0-loglikelihood
- hendrycksTest-college_biology-v0-res.json
- hendrycksTest-college_chemistry-v0-loglikelihood
- hendrycksTest-college_chemistry-v0-res.json
- hendrycksTest-college_computer_science-v0-loglikelihood
- hendrycksTest-college_computer_science-v0-res.json
- hendrycksTest-college_mathematics-v0-loglikelihood
- hendrycksTest-college_mathematics-v0-res.json
- hendrycksTest-college_medicine-v0-loglikelihood
- hendrycksTest-college_medicine-v0-res.json
- hendrycksTest-college_physics-v0-loglikelihood
- hendrycksTest-college_physics-v0-res.json
- hendrycksTest-computer_security-v0-loglikelihood
- hendrycksTest-computer_security-v0-res.json
- hendrycksTest-conceptual_physics-v0-loglikelihood
- hendrycksTest-conceptual_physics-v0-res.json
- hendrycksTest-econometrics-v0-loglikelihood
- hendrycksTest-econometrics-v0-res.json
- hendrycksTest-electrical_engineering-v0-loglikelihood
- hendrycksTest-electrical_engineering-v0-res.json
- hendrycksTest-elementary_mathematics-v0-loglikelihood
- hendrycksTest-elementary_mathematics-v0-res.json
- hendrycksTest-formal_logic-v0-loglikelihood
- hendrycksTest-formal_logic-v0-res.json
- hendrycksTest-global_facts-v0-loglikelihood
- hendrycksTest-global_facts-v0-res.json
- hendrycksTest-high_school_biology-v0-loglikelihood
- hendrycksTest-high_school_biology-v0-res.json
- hendrycksTest-high_school_chemistry-v0-loglikelihood
- hendrycksTest-high_school_chemistry-v0-res.json
- hendrycksTest-high_school_computer_science-v0-loglikelihood
- hendrycksTest-high_school_computer_science-v0-res.json
- hendrycksTest-high_school_european_history-v0-loglikelihood
- hendrycksTest-high_school_european_history-v0-res.json
- hendrycksTest-high_school_geography-v0-loglikelihood
- hendrycksTest-high_school_geography-v0-res.json
- hendrycksTest-high_school_government_and_politics-v0-loglikelihood
- hendrycksTest-high_school_government_and_politics-v0-res.json
- hendrycksTest-high_school_macroeconomics-v0-loglikelihood
- hendrycksTest-high_school_macroeconomics-v0-res.json
- hendrycksTest-high_school_mathematics-v0-loglikelihood
- hendrycksTest-high_school_mathematics-v0-res.json
- hendrycksTest-high_school_microeconomics-v0-loglikelihood
- hendrycksTest-high_school_microeconomics-v0-res.json
- hendrycksTest-high_school_physics-v0-loglikelihood
- hendrycksTest-high_school_physics-v0-res.json
- hendrycksTest-high_school_psychology-v0-loglikelihood
- hendrycksTest-high_school_psychology-v0-res.json
- hendrycksTest-high_school_statistics-v0-loglikelihood
- hendrycksTest-high_school_statistics-v0-res.json
- hendrycksTest-high_school_us_history-v0-loglikelihood
- hendrycksTest-high_school_us_history-v0-res.json
- hendrycksTest-high_school_world_history-v0-loglikelihood
- hendrycksTest-high_school_world_history-v0-res.json
- hendrycksTest-human_aging-v0-loglikelihood
- hendrycksTest-human_aging-v0-res.json
- hendrycksTest-human_sexuality-v0-loglikelihood
- hendrycksTest-human_sexuality-v0-res.json
- hendrycksTest-international_law-v0-loglikelihood
- hendrycksTest-international_law-v0-res.json
- hendrycksTest-jurisprudence-v0-loglikelihood
- hendrycksTest-jurisprudence-v0-res.json
- hendrycksTest-logical_fallacies-v0-loglikelihood
- hendrycksTest-logical_fallacies-v0-res.json
- hendrycksTest-machine_learning-v0-loglikelihood
- hendrycksTest-machine_learning-v0-res.json
- hendrycksTest-management-v0-loglikelihood
- hendrycksTest-management-v0-res.json
- hendrycksTest-marketing-v0-loglikelihood
- hendrycksTest-marketing-v0-res.json
- hendrycksTest-medical_genetics-v0-loglikelihood
- hendrycksTest-medical_genetics-v0-res.json
- hendrycksTest-miscellaneous-v0-loglikelihood
- hendrycksTest-miscellaneous-v0-res.json
- hendrycksTest-moral_disputes-v0-loglikelihood
- hendrycksTest-moral_disputes-v0-res.json
- hendrycksTest-moral_scenarios-v0-loglikelihood
- hendrycksTest-moral_scenarios-v0-res.json
- hendrycksTest-nutrition-v0-loglikelihood
- hendrycksTest-nutrition-v0-res.json
- hendrycksTest-philosophy-v0-loglikelihood
- hendrycksTest-philosophy-v0-res.json
- hendrycksTest-prehistory-v0-loglikelihood
- hendrycksTest-prehistory-v0-res.json
- hendrycksTest-professional_accounting-v0-loglikelihood
- hendrycksTest-professional_accounting-v0-res.json
- hendrycksTest-professional_law-v0-loglikelihood
- hendrycksTest-professional_law-v0-res.json
- hendrycksTest-professional_medicine-v0-loglikelihood
- hendrycksTest-professional_medicine-v0-res.json
- hendrycksTest-professional_psychology-v0-loglikelihood
- hendrycksTest-professional_psychology-v0-res.json
- hendrycksTest-public_relations-v0-loglikelihood
- hendrycksTest-public_relations-v0-res.json
- hendrycksTest-security_studies-v0-loglikelihood
- hendrycksTest-security_studies-v0-res.json
- hendrycksTest-sociology-v0-loglikelihood
- hendrycksTest-sociology-v0-res.json
- hendrycksTest-us_foreign_policy-v0-loglikelihood
- hendrycksTest-us_foreign_policy-v0-res.json
- hendrycksTest-virology-v0-loglikelihood
- hendrycksTest-virology-v0-res.json
- hendrycksTest-world_religions-v0-loglikelihood
- hendrycksTest-world_religions-v0-res.json
- iwslt17-ar-en-v0-greedy_until
- iwslt17-ar-en-v0-res.json
- iwslt17-en-ar-v0-greedy_until
- iwslt17-en-ar-v0-res.json
- lambada-v0-loglikelihood
- lambada-v0-res.json
- lambada_cloze-v0-loglikelihood
- lambada_cloze-v0-res.json
- lambada_mt_de-v0-loglikelihood
- lambada_mt_de-v0-res.json
- lambada_mt_en-v0-loglikelihood
- lambada_mt_en-v0-res.json
- lambada_mt_es-v0-loglikelihood
- lambada_mt_es-v0-res.json
- lambada_mt_fr-v0-loglikelihood
- lambada_mt_fr-v0-res.json
- lambada_mt_it-v0-loglikelihood
- lambada_mt_it-v0-res.json
- lambada_openai-v0-loglikelihood
- lambada_openai-v0-res.json
- lambada_openai-v2.0-loglikelihood
- lambada_openai-v2.0-res.json
- lambada_openai_cloze-v0-loglikelihood
- lambada_openai_cloze-v0-res.json
- lambada_openai_mt_de-v0-loglikelihood
- lambada_openai_mt_de-v0-res.json
- lambada_openai_mt_en-v0-loglikelihood
- lambada_openai_mt_en-v0-res.json
- lambada_openai_mt_es-v0-loglikelihood
- lambada_openai_mt_es-v0-res.json
- lambada_openai_mt_fr-v0-loglikelihood
- lambada_openai_mt_fr-v0-res.json
- lambada_openai_mt_it-v0-loglikelihood
- lambada_openai_mt_it-v0-res.json
- lambada_standard-v0-loglikelihood
- lambada_standard-v0-res.json
- lambada_standard_cloze-v0-loglikelihood
- lambada_standard_cloze-v0-res.json
- logiqa-v0-loglikelihood
- logiqa-v0-res.json
- math_algebra-v0-greedy_until
- math_algebra-v0-res.json
- math_algebra-v1-greedy_until
- math_algebra-v1-res.json
- math_counting_and_prob-v0-greedy_until
- math_counting_and_prob-v0-res.json
- math_counting_and_prob-v1-greedy_until
- math_counting_and_prob-v1-res.json
- math_geometry-v0-greedy_until
- math_geometry-v0-res.json
- math_geometry-v1-greedy_until
- math_geometry-v1-res.json
- math_intermediate_algebra-v0-greedy_until
- math_intermediate_algebra-v0-res.json
- math_intermediate_algebra-v1-greedy_until
- math_intermediate_algebra-v1-res.json
- math_num_theory-v0-greedy_until
- math_num_theory-v0-res.json
- math_num_theory-v1-greedy_until
- math_num_theory-v1-res.json
- math_prealgebra-v0-greedy_until
- math_prealgebra-v0-res.json
- math_prealgebra-v1-greedy_until
- math_prealgebra-v1-res.json
- math_precalc-v0-greedy_until
- math_precalc-v0-res.json
- math_precalc-v1-greedy_until
- math_precalc-v1-res.json
- mathqa-v0-loglikelihood
- mathqa-v0-res.json
- mc_taco-v0-loglikelihood
- mc_taco-v0-res.json
- mnli-v0-loglikelihood
- mnli-v0-res.json
- mnli_mismatched-v0-loglikelihood
- mnli_mismatched-v0-res.json
- mrpc-v0-loglikelihood
- mrpc-v0-res.json
- multirc-v0-loglikelihood
- multirc-v0-res.json
- multirc-v1-loglikelihood
- multirc-v1-res.json
- mutual-v0-loglikelihood
- mutual-v0-res.json
- mutual-v1-loglikelihood
- mutual-v1-res.json
- mutual_plus-v0-loglikelihood
- mutual_plus-v0-res.json
- mutual_plus-v1-loglikelihood
- mutual_plus-v1-res.json
- openbookqa-v0-loglikelihood
- openbookqa-v0-res.json
- pile_arxiv-v0-loglikelihood_rolling
- pile_arxiv-v0-res.json
- pile_arxiv-v1-loglikelihood_rolling
- pile_arxiv-v1-res.json
- pile_bookcorpus2-v0-loglikelihood_rolling
- pile_bookcorpus2-v0-res.json
- pile_bookcorpus2-v1-loglikelihood_rolling
- pile_bookcorpus2-v1-res.json
- pile_books3-v0-loglikelihood_rolling
- pile_books3-v0-res.json
- pile_books3-v1-loglikelihood_rolling
- pile_books3-v1-res.json
- pile_dm-mathematics-v0-loglikelihood_rolling
- pile_dm-mathematics-v0-res.json
- pile_dm-mathematics-v1-loglikelihood_rolling
- pile_dm-mathematics-v1-res.json
- pile_enron-v0-loglikelihood_rolling
- pile_enron-v0-res.json
- pile_enron-v1-loglikelihood_rolling
- pile_enron-v1-res.json
- pile_europarl-v0-loglikelihood_rolling
- pile_europarl-v0-res.json
- pile_europarl-v1-loglikelihood_rolling
- pile_europarl-v1-res.json
- pile_freelaw-v0-loglikelihood_rolling
- pile_freelaw-v0-res.json
- pile_freelaw-v1-loglikelihood_rolling
- pile_freelaw-v1-res.json
- pile_github-v0-loglikelihood_rolling
- pile_github-v0-res.json
- pile_github-v1-loglikelihood_rolling
- pile_github-v1-res.json
- pile_gutenberg-v0-loglikelihood_rolling
- pile_gutenberg-v0-res.json
- pile_gutenberg-v1-loglikelihood_rolling
- pile_gutenberg-v1-res.json
- pile_hackernews-v0-loglikelihood_rolling
- pile_hackernews-v0-res.json
- pile_hackernews-v1-loglikelihood_rolling
- pile_hackernews-v1-res.json
- pile_nih-exporter-v0-loglikelihood_rolling
- pile_nih-exporter-v0-res.json
- pile_nih-exporter-v1-loglikelihood_rolling
- pile_nih-exporter-v1-res.json
- pile_opensubtitles-v0-loglikelihood_rolling
- pile_opensubtitles-v0-res.json
- pile_opensubtitles-v1-loglikelihood_rolling
- pile_opensubtitles-v1-res.json
- pile_openwebtext2-v0-loglikelihood_rolling
- pile_openwebtext2-v0-res.json
- pile_openwebtext2-v1-loglikelihood_rolling
- pile_openwebtext2-v1-res.json
- pile_philpapers-v0-loglikelihood_rolling
- pile_philpapers-v0-res.json
- pile_philpapers-v1-loglikelihood_rolling
- pile_philpapers-v1-res.json
- pile_pile-cc-v0-loglikelihood_rolling
- pile_pile-cc-v0-res.json
- pile_pile-cc-v1-loglikelihood_rolling
- pile_pile-cc-v1-res.json
- pile_pubmed-abstracts-v0-loglikelihood_rolling
- pile_pubmed-abstracts-v0-res.json
- pile_pubmed-abstracts-v1-loglikelihood_rolling
- pile_pubmed-abstracts-v1-res.json
- pile_pubmed-central-v0-loglikelihood_rolling
- pile_pubmed-central-v0-res.json
- pile_pubmed-central-v1-loglikelihood_rolling
- pile_pubmed-central-v1-res.json
- pile_stackexchange-v0-loglikelihood_rolling
- pile_stackexchange-v0-res.json
- pile_stackexchange-v1-loglikelihood_rolling
- pile_stackexchange-v1-res.json
- pile_ubuntu-irc-v0-loglikelihood_rolling
- pile_ubuntu-irc-v0-res.json
- pile_ubuntu-irc-v1-loglikelihood_rolling
- pile_ubuntu-irc-v1-res.json
- pile_uspto-v0-loglikelihood_rolling
- pile_uspto-v0-res.json
- pile_uspto-v1-loglikelihood_rolling
- pile_uspto-v1-res.json
- pile_wikipedia-v0-loglikelihood_rolling
- pile_wikipedia-v0-res.json
- pile_wikipedia-v1-loglikelihood_rolling
- pile_wikipedia-v1-res.json
- pile_youtubesubtitles-v0-loglikelihood_rolling
- pile_youtubesubtitles-v0-res.json
- pile_youtubesubtitles-v1-loglikelihood_rolling
- pile_youtubesubtitles-v1-res.json
- piqa-v0-loglikelihood
- piqa-v0-res.json
- prost-v0-loglikelihood
- prost-v0-res.json
- pubmedqa-v0-loglikelihood
- pubmedqa-v0-res.json
- qa4mre_2011-v0-loglikelihood
- qa4mre_2011-v0-res.json
- qa4mre_2012-v0-loglikelihood
- qa4mre_2012-v0-res.json
- qa4mre_2013-v0-loglikelihood
- qa4mre_2013-v0-res.json
- qnli-v0-loglikelihood
- qnli-v0-res.json
- qqp-v0-loglikelihood
- qqp-v0-res.json
- race-v0-loglikelihood
- race-v0-res.json
- random_insertion-v0-greedy_until
- random_insertion-v0-res.json
- record-v0-loglikelihood
- record-v0-res.json
- reversed_words-v0-greedy_until
- reversed_words-v0-res.json
- rte-v0-loglikelihood
- rte-v0-res.json
- sciq-v0-loglikelihood
- sciq-v0-res.json
- squad2-v0-greedy_until
- squad2-v0-loglikelihood
- squad2-v0-res.json
- squad2-v1-greedy_until
- squad2-v1-loglikelihood
- squad2-v1-res.json
- sst-v0-loglikelihood
- sst-v0-res.json
- swag-v0-loglikelihood
- swag-v0-res.json
- textsynth_test_0a89c2739f9598b4be2674b0a8e43931d7f3f0b696970bcba31f9b52bdf12297.pkl
- textsynth_test_0c1c14571add7903b89e588c8212572b95bb57b334fc0752c89a7e045a5f63ae.pkl
- textsynth_test_3092d07756f3e1d010c07524cc8a2ecba7f0c19f9e39f2aaf2bf440bfe328004.pkl
- textsynth_test_434076260b6af3a46b7a5eaceec3306a5872c400a3872f744280b237455a0f8e.pkl
- textsynth_test_49c47ae40e11f349f2f6b492128188b1b2bc103a421c676ee4b2142a68b43516.pkl
- textsynth_test_4fd8d66a6dad7f602b40e5d7dc298d6fe329299d086a4659743a41f4a4012659.pkl
- textsynth_test_51b5302f157cf224f694ccad973f255ae19e9e061d533256bdf75b04e0a917ab.pkl
- textsynth_test_6d6c62dd70caaa208712bf766deaf419cfac89538d4ab7745621e339394c0c23.pkl
- textsynth_test_7209c4617547bfe17cb9e7f5f735fe35822d650aefdc5fbeeaf0c1724effbe09.pkl
- textsynth_test_7afdc285388e51094e12645f305328c759574fa3ec9751631025f8ad5ebf9f3e.pkl
- textsynth_test_9d5f33dbfe1e254928c89f5ed85e4c010d888065f55a8f1b863bc1eb0340a5f2.pkl
- textsynth_test_abcbcba648d89e5d81a50511a6d24ddeb538de2ffe108c1370dd74ce6ac8038d.pkl
- textsynth_test_b1cbb29666cce5e31a1e97695858137398a0885ca5d5d98f515404fb6aeb99e7.pkl
- textsynth_test_e7ad1e9f52a39e1ddd1e50f3c57ffa4546728dd150a67c0a0ddc8675c04e15d1.pkl
- textsynth_test_f4bfe4beb605bd52a8ab6be3c9293639e7e2261d98de58159d15ccb83131bf4e.pkl
- toxigen-v0-loglikelihood
- toxigen-v0-res.json
- triviaqa-v0-loglikelihood
- triviaqa-v0-res.json
- triviaqa-v1-loglikelihood
- triviaqa-v1-res.json
- truthfulqa_gen-v0-greedy_until
- truthfulqa_gen-v0-res.json
- truthfulqa_gen-v1-greedy_until
- truthfulqa_gen-v1-res.json
- truthfulqa_mc-v0-loglikelihood
- truthfulqa_mc-v0-res.json
- truthfulqa_mc-v1-loglikelihood
- truthfulqa_mc-v1-res.json
- webqs-v0-loglikelihood
- webqs-v0-res.json
- wic-v0-loglikelihood
- wic-v0-res.json
- wikitext-v0-loglikelihood_rolling
- wikitext-v0-res.json
- wikitext-v1-loglikelihood_rolling
- wikitext-v1-res.json
- winogrande-v0-loglikelihood
- winogrande-v0-res.json
- wmt14-en-fr-v0-greedy_until
- wmt14-en-fr-v0-res.json
- wmt14-fr-en-v0-greedy_until
- wmt14-fr-en-v0-res.json
- wmt16-de-en-v0-greedy_until
- wmt16-de-en-v0-res.json
- wmt16-en-de-v0-greedy_until
- wmt16-en-de-v0-res.json
- wmt16-en-ro-v0-greedy_until
- wmt16-en-ro-v0-res.json
- wmt16-ro-en-v0-greedy_until
- wmt16-ro-en-v0-res.json
- wmt20-cs-en-v0-greedy_until
- wmt20-cs-en-v0-res.json
- wmt20-de-en-v0-greedy_until
- wmt20-de-en-v0-res.json
- wmt20-de-fr-v0-greedy_until
- wmt20-de-fr-v0-res.json
- wmt20-en-cs-v0-greedy_until
- wmt20-en-cs-v0-res.json
- wmt20-en-de-v0-greedy_until
- wmt20-en-de-v0-res.json
- wmt20-en-iu-v0-greedy_until
- wmt20-en-iu-v0-res.json
- wmt20-en-ja-v0-greedy_until
- wmt20-en-ja-v0-res.json
- wmt20-en-ja-v1-greedy_until
- wmt20-en-ja-v1-res.json
- wmt20-en-km-v0-greedy_until
- wmt20-en-km-v0-res.json
- wmt20-en-pl-v0-greedy_until
- wmt20-en-pl-v0-res.json
- wmt20-en-ps-v0-greedy_until
- wmt20-en-ps-v0-res.json
- wmt20-en-ru-v0-greedy_until
- wmt20-en-ru-v0-res.json
- wmt20-en-ta-v0-greedy_until
- wmt20-en-ta-v0-res.json
- wmt20-en-zh-v0-greedy_until
- wmt20-en-zh-v0-res.json
- wmt20-en-zh-v1-greedy_until
- wmt20-en-zh-v1-res.json
- wmt20-fr-de-v0-greedy_until
- wmt20-fr-de-v0-res.json
- wmt20-iu-en-v0-greedy_until
- wmt20-iu-en-v0-res.json
- wmt20-ja-en-v0-greedy_until
- wmt20-ja-en-v0-res.json
- wmt20-km-en-v0-greedy_until
- wmt20-km-en-v0-res.json
- wmt20-pl-en-v0-greedy_until
- wmt20-pl-en-v0-res.json
- wmt20-ps-en-v0-greedy_until
- wmt20-ps-en-v0-res.json
- wmt20-ru-en-v0-greedy_until
- wmt20-ru-en-v0-res.json
- wmt20-ta-en-v0-greedy_until
- wmt20-ta-en-v0-res.json
- wmt20-zh-en-v0-greedy_until
- wmt20-zh-en-v0-res.json
- wnli-v0-loglikelihood
- wnli-v0-res.json
- wnli-v1-loglikelihood
- wnli-v1-res.json
- wsc-v0-loglikelihood
- wsc-v0-res.json
- wsc273-v0-loglikelihood
- wsc273-v0-res.json
- test_description.py
- test_generate_13_grams.py
- test_models.py
- test_version_stable.py
- __init__.py
- test_evaluator.py
- test_janitor.py
- test_misc.py
- test_tasks.py
- test_utils.py
- utils.py
- .coveragerc
- .DS_Store
- .flake8
- .gitignore
- .pre-commit-config.yaml
- CITATION.bib
- CODEOWNERS
- ignore.txt
- LICENSE.md
- mypy.ini
- pile_statistics.json
- pyproject.toml
- README.md
- requirements.txt
- setup.py
- .DS_Store
- gptneox_attn_replace.cpython-39.pyc
- llama_attn_replace.cpython-39.pyc
- llama_attn_replace_sft.cpython-39.pyc
- tree_filter_func.cpython-39.pyc
- tree_filter_func_aggre.cpython-39.pyc
- tree_scanning.cpython-39.pyc
- alpaca_data.json
- stage2.json
- stage3.json
- exact_match.py
- __init__.py
- modify_falcon.py
- modify_gpt_neox.py
- modify_llama.py
- __init__.py
- enable_streaming_llm.py
- kv_cache.py
- utils.py
- tree_filter_core.cpython-39.pyc
- tree_filter_v2.cpython-39.pyc
- bfs.cu
- bfs.h
- boruvka.cu
- boruvka.h
- boruvka_rst.cu
- boruvka_rst.h
- mst.cu
- mst.h
- refine.cu
- refine.h
- rst.cu
- rst.h
- vision.cpp
- _C.cpython-39-x86_64-linux-gnu.so
- .DS_Store
- setup.py
- __init__.cpython-39.pyc
- activations.cpython-39.pyc
- activations_tf.cpython-39.pyc
- audio_utils.cpython-39.pyc
- cache_utils.cpython-39.pyc
- configuration_utils.cpython-39.pyc
- convert_graph_to_onnx.cpython-39.pyc
- convert_pytorch_checkpoint_to_tf2.cpython-39.pyc
- convert_slow_tokenizer.cpython-39.pyc
- convert_slow_tokenizers_checkpoints_to_fast.cpython-39.pyc
- convert_tf_hub_seq_to_seq_bert_to_pytorch.cpython-39.pyc
- debug_utils.cpython-39.pyc
- deepspeed.cpython-39.pyc
- dependency_versions_check.cpython-39.pyc
- dependency_versions_table.cpython-39.pyc
- dynamic_module_utils.cpython-39.pyc
- feature_extraction_sequence_utils.cpython-39.pyc
- feature_extraction_utils.cpython-39.pyc
- file_utils.cpython-39.pyc
- generation_flax_utils.cpython-39.pyc
- generation_tf_utils.cpython-39.pyc
- generation_utils.cpython-39.pyc
- hf_argparser.cpython-39.pyc
- hyperparameter_search.cpython-39.pyc
- image_processing_utils.cpython-39.pyc
- image_transforms.cpython-39.pyc
- image_utils.cpython-39.pyc
- keras_callbacks.cpython-39.pyc
- modelcard.cpython-39.pyc
- modeling_attn_mask_utils.cpython-39.pyc
- modeling_flax_outputs.cpython-39.pyc
- modeling_flax_pytorch_utils.cpython-39.pyc
- modeling_flax_utils.cpython-39.pyc
- modeling_outputs.cpython-39.pyc
- modeling_tf_outputs.cpython-39.pyc
- modeling_tf_pytorch_utils.cpython-39.pyc
- modeling_tf_utils.cpython-39.pyc
- modeling_utils.cpython-39.pyc
- optimization.cpython-39.pyc
- optimization_tf.cpython-39.pyc
- processing_utils.cpython-39.pyc
- pytorch_utils.cpython-39.pyc
- safetensors_conversion.cpython-39.pyc
- testing_utils.cpython-39.pyc
- tf_utils.cpython-39.pyc
- time_series_utils.cpython-39.pyc
- tokenization_utils.cpython-39.pyc
- tokenization_utils_base.cpython-39.pyc
- tokenization_utils_fast.cpython-39.pyc
- trainer.cpython-39.pyc
- trainer_callback.cpython-39.pyc
- trainer_pt_utils.cpython-39.pyc
- trainer_seq2seq.cpython-39.pyc
- trainer_utils.cpython-39.pyc
- training_args.cpython-39.pyc
- training_args_seq2seq.cpython-39.pyc
- training_args_tf.cpython-39.pyc
- __init__.cpython-39.pyc
- benchmark.cpython-39.pyc
- benchmark_args.cpython-39.pyc
- benchmark_args_tf.cpython-39.pyc
- benchmark_args_utils.cpython-39.pyc
- benchmark_tf.cpython-39.pyc
- benchmark_utils.cpython-39.pyc
- __init__.py
- benchmark.py
- benchmark_args.py
- benchmark_args_tf.py
- benchmark_args_utils.py
- benchmark_tf.py
- benchmark_utils.py
- __init__.cpython-39.pyc
- add_new_model.cpython-39.pyc
- add_new_model_like.cpython-39.pyc
- convert.cpython-39.pyc
- download.cpython-39.pyc
- env.cpython-39.pyc
- lfs.cpython-39.pyc
- pt_to_tf.cpython-39.pyc
- run.cpython-39.pyc
- serving.cpython-39.pyc
- train.cpython-39.pyc
- transformers_cli.cpython-39.pyc
- user.cpython-39.pyc
- __init__.py
- add_new_model.py
- add_new_model_like.py
- convert.py
- download.py
- env.py
- lfs.py
- pt_to_tf.py
- run.py
- serving.py
- train.py
- transformers_cli.py
- user.py
- __init__.cpython-39.pyc
- data_collator.cpython-39.pyc
- __init__.cpython-39.pyc
- glue.cpython-39.pyc
- language_modeling.cpython-39.pyc
- squad.cpython-39.pyc
- __init__.py
- glue.py
- language_modeling.py
- squad.py
- __init__.cpython-39.pyc
- squad_metrics.cpython-39.pyc
- __init__.py
- squad_metrics.py
- __init__.cpython-39.pyc
- glue.cpython-39.pyc
- squad.cpython-39.pyc
- utils.cpython-39.pyc
- xnli.cpython-39.pyc
- __init__.py
- glue.py
- squad.py
- utils.py
- xnli.py
- .DS_Store
- __init__.py
- data_collator.py
- __init__.cpython-39.pyc
- beam_constraints.cpython-39.pyc
- beam_search.cpython-39.pyc
- candidate_generator.cpython-39.pyc
- configuration_utils.cpython-39.pyc
- flax_logits_process.cpython-39.pyc
- flax_utils.cpython-39.pyc
- logits_process.cpython-39.pyc
- stopping_criteria.cpython-39.pyc
- streamers.cpython-39.pyc
- tf_logits_process.cpython-39.pyc
- tf_utils.cpython-39.pyc
- utils.cpython-39.pyc
- __init__.py
- beam_constraints.py
- beam_search.py
- candidate_generator.py
- configuration_utils.py
- flax_logits_process.py
- flax_utils.py
- logits_process.py
- stopping_criteria.py
- streamers.py
- tf_logits_process.py
- tf_utils.py
- utils.py
- __init__.cpython-39.pyc
- aqlm.cpython-39.pyc
- awq.cpython-39.pyc
- bitsandbytes.cpython-39.pyc
- deepspeed.cpython-39.pyc
- integration_utils.cpython-39.pyc
- peft.cpython-39.pyc
- quanto.cpython-39.pyc
- tpu.cpython-39.pyc
- __init__.py
- aqlm.py
- awq.py
- bitsandbytes.py
- deepspeed.py
- integration_utils.py
- peft.py
- quanto.py
- tpu.py
- ms_deform_attn_cpu.cpp
- ms_deform_attn_cpu.h
- ms_deform_attn_cuda.cu
- ms_deform_attn_cuda.cuh
- ms_deform_attn_cuda.h
- ms_deform_im2col_cuda.cuh
- ms_deform_attn.h
- vision.cpp
- ms_deform_attn_cpu.cpp
- ms_deform_attn_cpu.h
- ms_deform_attn_cuda.cu
- ms_deform_attn_cuda.cuh
- ms_deform_attn_cuda.h
- ms_deform_im2col_cuda.cuh
- ms_deform_attn.h
- vision.cpp
- cuda_kernel.cu
- cuda_kernel.h
- cuda_launch.cu
- cuda_launch.h
- torch_extension.cpp
- wkv_cuda.cu
- wkv_cuda_bf16.cu
- wkv_op.cpp
- common.h
- common_cuda.h
- common_cuda_device.h
- fast_lsh_cumulation.cu
- fast_lsh_cumulation.h
- fast_lsh_cumulation_cuda.cu
- fast_lsh_cumulation_cuda.h
- fast_lsh_cumulation_torch.cpp
- .DS_Store
- __init__.cpython-39.pyc
- __init__.cpython-39.pyc
- configuration_albert.cpython-39.pyc
- convert_albert_original_tf_checkpoint_to_pytorch.cpython-39.pyc
- modeling_albert.cpython-39.pyc
- modeling_flax_albert.cpython-39.pyc
- modeling_tf_albert.cpython-39.pyc
- tokenization_albert.cpython-39.pyc
- tokenization_albert_fast.cpython-39.pyc
- __init__.py
- configuration_albert.py
- convert_albert_original_tf_checkpoint_to_pytorch.py
- modeling_albert.py
- modeling_flax_albert.py
- modeling_tf_albert.py
- tokenization_albert.py
- tokenization_albert_fast.py
- __init__.cpython-39.pyc
- configuration_align.cpython-39.pyc
- convert_align_tf_to_hf.cpython-39.pyc
- modeling_align.cpython-39.pyc
- processing_align.cpython-39.pyc
- __init__.py
- configuration_align.py
- convert_align_tf_to_hf.py
- modeling_align.py
- processing_align.py
- __init__.cpython-39.pyc
- configuration_altclip.cpython-39.pyc
- modeling_altclip.cpython-39.pyc
- processing_altclip.cpython-39.pyc
- __init__.py
- configuration_altclip.py
- modeling_altclip.py
- processing_altclip.py
- __init__.cpython-39.pyc
- configuration_audio_spectrogram_transformer.cpython-39.pyc
- convert_audio_spectrogram_transformer_original_to_pytorch.cpython-39.pyc
- feature_extraction_audio_spectrogram_transformer.cpython-39.pyc
- modeling_audio_spectrogram_transformer.cpython-39.pyc
- __init__.py
- configuration_audio_spectrogram_transformer.py
- convert_audio_spectrogram_transformer_original_to_pytorch.py
- feature_extraction_audio_spectrogram_transformer.py
- modeling_audio_spectrogram_transformer.py
- __init__.cpython-39.pyc
- auto_factory.cpython-39.pyc
- configuration_auto.cpython-39.pyc
- feature_extraction_auto.cpython-39.pyc
- image_processing_auto.cpython-39.pyc
- modeling_auto.cpython-39.pyc
- modeling_flax_auto.cpython-39.pyc
- modeling_tf_auto.cpython-39.pyc
- processing_auto.cpython-39.pyc
- tokenization_auto.cpython-39.pyc
- __init__.py
- auto_factory.py
- configuration_auto.py
- feature_extraction_auto.py
- image_processing_auto.py
- modeling_auto.py
- modeling_flax_auto.py
- modeling_tf_auto.py
- processing_auto.py
- tokenization_auto.py
- __init__.cpython-39.pyc
- configuration_autoformer.cpython-39.pyc
- modeling_autoformer.cpython-39.pyc
- __init__.py
- configuration_autoformer.py
- modeling_autoformer.py
- __init__.cpython-39.pyc
- configuration_bark.cpython-39.pyc
- convert_suno_to_hf.cpython-39.pyc
- generation_configuration_bark.cpython-39.pyc
- modeling_bark.cpython-39.pyc
- processing_bark.cpython-39.pyc
- __init__.py
- configuration_bark.py
- convert_suno_to_hf.py
- generation_configuration_bark.py
- modeling_bark.py
- processing_bark.py
- __init__.cpython-39.pyc
- configuration_bart.cpython-39.pyc
- convert_bart_original_pytorch_checkpoint_to_pytorch.cpython-39.pyc
- modeling_bart.cpython-39.pyc
- modeling_flax_bart.cpython-39.pyc
- modeling_tf_bart.cpython-39.pyc
- tokenization_bart.cpython-39.pyc
- tokenization_bart_fast.cpython-39.pyc
- __init__.py
- configuration_bart.py
- convert_bart_original_pytorch_checkpoint_to_pytorch.py
- modeling_bart.py
- .DS_Store
- __init__.py
- .DS_Store
- __init__.py
- activations.py
- activations_tf.py
- audio_utils.py
- cache_utils.py
- configuration_utils.py
- convert_graph_to_onnx.py
- convert_pytorch_checkpoint_to_tf2.py
- convert_slow_tokenizer.py
- convert_slow_tokenizers_checkpoints_to_fast.py
- convert_tf_hub_seq_to_seq_bert_to_pytorch.py
- debug_utils.py
- deepspeed.py
- dependency_versions_check.py
- dependency_versions_table.py
- dynamic_module_utils.py
- feature_extraction_sequence_utils.py
- feature_extraction_utils.py
- file_utils.py
- generation_flax_utils.py
- generation_tf_utils.py
- generation_utils.py
- hf_argparser.py
- hyperparameter_search.py
- image_processing_utils.py
- image_transforms.py
- image_utils.py
- keras_callbacks.py
- modelcard.py
- modeling_attn_mask_utils.py
- modeling_flax_outputs.py
- modeling_flax_pytorch_utils.py
- modeling_flax_utils.py
- modeling_outputs.py
- modeling_tf_outputs.py
- modeling_tf_pytorch_utils.py
- modeling_tf_utils.py
- modeling_utils.py
- .DS_Store
- eval.sh
- grootl_requirements.txt
- LICENSE
- lm_harness_eval.py
- merge.sh
- merge_lora_weights_and_save_hf_model.py
- st_train.sh
- supervised-fine-tune.py
- .DS_Store
# 설치 가이드
1. 코드 내려받기
git clone https://github.com/EasonXiao-888/MambaTree
깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.
cd MambaTree
방금 내려받은 프로젝트 폴더 안으로 이동합니다.
2. 공식 설치 스크립트
쉬움 추천사전 준비물
- Python 3 pip 명령어를 쓰려면 Python이 필요합니다.
pip install torch==1.13.1+cu117 torchvision==0.14.1+cu117 torchaudio==0.13.1 --extra-index-url https://download.pytorch.org/whl/cu117
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install -v -e .
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install torch==2.0.1 torchvision==0.15.2 torchaudio==2.0.2
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
설치 후 새 터미널을 열고, 프로그램의 버전 확인 명령(예: --version)으로 정상 설치됐는지 확인하세요.
이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.
3. Python
쉬움사전 준비물
pip install torch==1.13.1+cu117 torchvision==0.14.1+cu117 torchaudio==0.13.1 --extra-index-url https://download.pytorch.org/whl/cu117
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install -r GrootV/grootv_requirements.txt
requirements.txt 등에 명시된 파이썬 라이브러리를 설치합니다.
pip install -v -e .
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install torch==2.0.1 torchvision==0.15.2 torchaudio==2.0.2
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install -r GrootL/grootl_requirements.txt
requirements.txt 등에 명시된 파이썬 라이브러리를 설치합니다.
에러 메시지 없이 실행되고 터미널에 안내 문구가 출력되면 정상입니다.
이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.
// repository documentation
Was this content helpful?
(0 ratings)
