xl-sum
This repository contains the code, data, and models of the paper titled "XL-Sum: Large-Scale Multilingual Abstractive Summarization for 44 Languages" published in Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021.
파일 탐색기
최종 버전 다운로드 (.zip)- README.md
- __init__.py
- io.py
- README.md
- requirements.txt
- rouge.py
- rouge_scorer.py
- scoring.py
- setup.cfg
- setup.py
- setuptools
- stemmers.py
- tokenization_wrapper.py
- tokenizers.py
- config.yml
- deploy.sh
- build.sh
- meta.yaml
- ---new-benchmark.md
- --new-model-addition.md
- bug-report.md
- feature-request.md
- migration.md
- question-help.md
- github-torch-hub.yml
- model-templates.yml
- release-conda.yml
- self-push.yml
- self-scheduled.yml
- PULL_REQUEST_TEMPLATE.md
- stale.yml
- Dockerfile
- Dockerfile
- Dockerfile
- Dockerfile
- bert-base-cased.jsonnet
- dataset.yaml
- docker-entrypoint.sh
- Dockerfile
- Dockerfile
- Dockerfile
- Calibre-Light.ttf
- Calibre-Medium.otf
- Calibre-Regular.otf
- Calibre-Thin.otf
- code-snippets.css
- huggingface.css
- custom.js
- huggingface_logo.svg
- local_attention_mask.png
- ppl_chunked.gif
- ppl_full.gif
- ppl_sliding.gif
- transformers_logo_name.png
- warmup_constant_schedule.png
- warmup_cosine_hard_restarts_schedule.png
- warmup_cosine_schedule.png
- warmup_cosine_warm_restarts_schedule.png
- warmup_linear_schedule.png
- generation_utils.rst
- modeling_utils.rst
- pipelines_utils.rst
- tokenization_utils.rst
- trainer_utils.rst
- callback.rst
- configuration.rst
- logging.rst
- model.rst
- optimizer_schedules.rst
- output.rst
- pipelines.rst
- processors.rst
- tokenizer.rst
- trainer.rst
- albert.rst
- auto.rst
- bart.rst
- barthez.rst
- bert.rst
- bertgeneration.rst
- blenderbot.rst
- camembert.rst
- ctrl.rst
- deberta.rst
- dialogpt.rst
- distilbert.rst
- dpr.rst
- electra.rst
- encoderdecoder.rst
- flaubert.rst
- fsmt.rst
- funnel.rst
- gpt.rst
- gpt2.rst
- layoutlm.rst
- longformer.rst
- lxmert.rst
- marian.rst
- mbart.rst
- mobilebert.rst
- mpnet.rst
- mt5.rst
- pegasus.rst
- prophetnet.rst
- rag.rst
- reformer.rst
- retribert.rst
- roberta.rst
- squeezebert.rst
- t5.rst
- tapas.rst
- transformerxl.rst
- xlm.rst
- xlmprophetnet.rst
- xlmroberta.rst
- xlnet.rst
- benchmarks.rst
- bertology.rst
- conf.py
- contributing.md
- converting_tensorflow_models.rst
- custom_datasets.rst
- examples.md
- favicon.ico
- glossary.rst
- index.rst
- installation.md
- migration.md
- model_sharing.rst
- model_summary.rst
- multilingual.rst
- notebooks.md
- perplexity.rst
- philosophy.rst
- preprocessing.rst
- pretrained_models.rst
- quicktour.rst
- serialization.rst
- task_summary.rst
- testing.rst
- tokenizer_summary.rst
- training.rst
- Makefile
- README.md
- plot_csv_file.py
- README.md
- requirements.txt
- run_benchmark.py
- run_benchmark_tf.py
- README.md
- requirements.txt
- run_clm.py
- run_mlm.py
- run_mlm_flax.py
- run_mlm_wwm.py
- run_plm.py
- run_multiple_choice.py
- utils_multiple_choice.py
- lightning_base.py
- requirements.txt
- run_glue.py
- run_glue.sh
- run_ner.py
- run_ner.sh
- run_pos.sh
- run_squad.py
- run_squad_trainer.py
- preprocess.py
- README.md
- run.sh
- run_chunk.sh
- run_ner.py
- run_pos.sh
- tasks.py
- utils_ner.py
- README.md
- run_camembert.py
- run_chinese_ref.py
- run_language_modeling.py
- run_openai_gpt.py
- run_swag.py
- run_transfo_xl.py
- README.md
- requirements.txt
- run_swag.py
- run_tf_multiple_choice.py
- utils_multiple_choice.py
- evaluate.py
- squad_v2_local.py
- README.md
- requirements.txt
- run_qa.py
- run_qa_beam_search.py
- run_tf_squad.py
- trainer_qa.py
- utils_qa.py
- README.md
- requirements.txt
- run_hans.py
- utils_hans.py
- __init__.py
- modeling_pabee_albert.py
- modeling_pabee_bert.py
- README.md
- requirements.txt
- run_glue_with_pabee.py
- test_run_glue_with_pabee.py
- __init__.py
- configuration_bertabs.py
- convert_bertabs_original_pytorch_checkpoint.py
- modeling_bertabs.py
- README.md
- requirements.txt
- run_summarization.py
- test_utils_summarization.py
- utils_summarization.py
- requirements.txt
- run_bertology.py
- run_prune_gpt.py
- __init__.py
- modeling_highway_bert.py
- modeling_highway_roberta.py
- entropy_eval.sh
- eval_deebert.sh
- README.md
- requirements.txt
- run_glue_deebert.py
- test_glue_deebert.py
- train_deebert.sh
- binarized_data.py
- extract.py
- extract_distilbert.py
- token_counts.py
- distilbert-base-cased.json
- distilbert-base-multilingual-cased.json
- distilbert-base-uncased.json
- distilgpt2.json
- distilroberta-base.json
- distiller.py
- grouped_batch_sampler.py
- lm_seqs_dataset.py
- README.md
- requirements.txt
- run_squad_w_distillation.py
- train.py
- utils.py
- eli5_app.py
- eli5_utils.py
- README.md
- requirements.txt
- README.md
- run_mmimdb.py
- utils_mmimdb.py
- __init__.py
- binarizer.py
- masked_nn.py
- __init__.py
- configuration_bert_masked.py
- modeling_bert_masked.py
- demo.ipynb
- extracting_data.py
- modeling_frcnn.py
- processing_image.py
- README.md
- requirements.txt
- utils.py
- visualizing_image.py
- bertarize.py
- counts_parameters.py
- masked_run_glue.py
- masked_run_squad.py
- README.md
- requirements.txt
- Saving_PruneBERT.ipynb
- full_script.sh
- modeling_flax_performer.py
- modeling_flax_performer_utils.py
- README.md
- run_mlm_performer.py
- sanity_script.sh
- headfigure.png
- wooly.png
- pplm_classification_head.py
- README.md
- requirements.txt
- run_pplm.py
- run_pplm_discrim_train.py
- my_knowledge_dataset.csv
- __init__.py
- _test_finetune_rag.py
- callbacks_rag.py
- consolidate_rag_checkpoint.py
- distributed_pytorch_retriever.py
- distributed_ray_retriever.py
- eval_rag.py
- finetune_rag.py
- finetune_rag.sh
- finetune_rag_ray.sh
- lightning_base.py
- parse_dpr_relevance_data.py
- README.md
- requirements.txt
- test_distributed_retriever.py
- use_own_knowledge_dataset.py
- utils_rag.py
- _test_bash_script.py
- _test_make_student.py
- _test_seq2seq_examples.py
- _test_seq2seq_examples_multi_gpu.py
- callbacks.py
- convert_pl_checkpoint_to_hf.py
- distil_marian_enro_teacher.sh
- distil_marian_no_teacher.sh
- distillation.py
- dynamic_bs_example.sh
- finetune.py
- finetune.sh
- finetune_bart_tiny.sh
- finetune_pegasus_xsum.sh
- finetune_t5.sh
- lightning_base.py
- make_student.py
- precomputed_pseudo_labels.md
- README.md
- requirements.txt
- run_eval.py
- sentence_splitter.py
- train_distilbart_cnn.sh
- train_distilbart_xsum.sh
- train_mbart_cc25_enro.sh
- utils copy.py
- utils.py
- README.md
- build-eval-data.py
- fsmt_val_data.json
- test.source
- test.target
- train.len
- train.source
- train.target
- val.len
- val.source
- val.target
- test_data
- __init__.py
- convert_model_to_fp16.py
- download_wmt.py
- finetune.sh
- finetune_tpu.sh
- finetune_trainer.py
- minify_dataset.py
- pack_dataset.py
- README.md
- requirements.txt
- romanian_postprocessing.md
- rouge_cli.py
- run_distributed_eval.py
- run_eval.py
- run_eval_search.py
- save_len_file.py
- save_randomly_initialized_model.py
- sentence_splitter.py
- seq2seq_trainer.py
- seq2seq_training_args.py
- test_calculate_rouge.py
- test_datasets.py
- test_finetune_trainer.py
- test_fsmt_bleu_score.py
- test_seq2seq_examples.py
- test_seq2seq_examples_multi_gpu.py
- test_tatoeba_conversion.py
- train_distil_marian_enro.sh
- train_distil_marian_enro_tpu.sh
- train_distilbart_cnn.sh
- train_mbart_cc25_enro.sh
- utils.py
- xla_spawn.py
- README.md
- requirements.txt
- run_glue.py
- run_tf_glue.py
- run_tf_text_classification.py
- run_xnli.py
- README.md
- requirements.txt
- run_generation.py
- README.md
- requirements.txt
- run.sh
- run_ner.py
- run_tf_ner.py
- _tests_requirements.txt
- conftest.py
- README.md
- test_examples.py
- test_xla_examples.py
- xla_spawn.py
- README.md
- README.md
- 01-training-tokenizers.ipynb
- 02-transformers.ipynb
- 03-pipelines.ipynb
- 04-onnx-export.ipynb
- 05-benchmark.ipynb
- README.md
- convert-allenai-wmt16.sh
- convert-allenai-wmt19.sh
- convert-facebook-wmt19.sh
- eval-allenai-wmt16.sh
- eval-allenai-wmt19.sh
- eval-facebook-wmt19.sh
- fsmt-make-super-tiny-model.py
- fsmt-make-tiny-model.py
- gen-card-allenai-wmt16.py
- gen-card-allenai-wmt19.py
- gen-card-facebook-wmt19.py
- s3-move.sh
- tests-to-run.sh
- build_test_sample_spm_no_bos.py
- README.md
- upload_models.sh
- __init__.py
- benchmark.py
- benchmark_args.py
- benchmark_args_tf.py
- benchmark_args_utils.py
- benchmark_tf.py
- benchmark_utils.py
- __init__.py
- add_new_model.py
- convert.py
- download.py
- env.py
- lfs.py
- run.py
- serving.py
- train.py
- transformers_cli.py
- user.py
- __init__.py
- glue.py
- language_modeling.py
- squad.py
- __init__.py
- squad_metrics.py
- __init__.py
- glue.py
- squad.py
- utils.py
- xnli.py
- __init__.py
- data_collator.py
- test_generation_utils.py
- __init__.py
- configuration_albert.py
- convert_albert_original_tf_checkpoint_to_pytorch.py
- modeling_albert.py
- modeling_tf_albert.py
- tokenization_albert.py
- tokenization_albert_fast.py
- __init__.py
- configuration_auto.py
- modeling_auto.py
- modeling_flax_auto.py
- modeling_tf_auto.py
- tokenization_auto.py
- __init__.py
- configuration_bart.py
- convert_bart_original_pytorch_checkpoint_to_pytorch.py
- modeling_bart.py
- modeling_tf_bart.py
- tokenization_bart.py
- tokenization_bart_fast.py
- __init__.py
- tokenization_barthez.py
- tokenization_barthez_fast.py
- __init__.py
- configuration_bert.py
- convert_bert_original_tf2_checkpoint_to_pytorch.py
- convert_bert_original_tf_checkpoint_to_pytorch.py
- convert_bert_pytorch_checkpoint_to_original_tf.py
- modeling_bert.py
- modeling_flax_bert.py
- modeling_tf_bert.py
- tokenization_bert.py
- tokenization_bert_fast.py
- __init__.py
- configuration_bert_generation.py
- modeling_bert_generation.py
- tokenization_bert_generation.py
- __init__.py
- tokenization_bert_japanese.py
- __init__.py
- tokenization_bertweet.py
- __init__.py
- configuration_blenderbot.py
- convert_blenderbot_original_pytorch_checkpoint_to_pytorch.py
- modeling_blenderbot.py
- modeling_tf_blenderbot.py
- tokenization_blenderbot.py
- __init__.py
- configuration_camembert.py
- modeling_camembert.py
- modeling_tf_camembert.py
- tokenization_camembert.py
- tokenization_camembert_fast.py
- __init__.py
- configuration_ctrl.py
- modeling_ctrl.py
- modeling_tf_ctrl.py
- tokenization_ctrl.py
- __init__.py
- configuration_deberta.py
- modeling_deberta.py
- tokenization_deberta.py
- __init__.py
- convert_dialogpt_original_pytorch_checkpoint_to_pytorch.py
- __init__.py
- configuration_distilbert.py
- modeling_distilbert.py
- modeling_tf_distilbert.py
- tokenization_distilbert.py
- tokenization_distilbert_fast.py
- __init__.py
- configuration_dpr.py
- convert_dpr_original_checkpoint_to_pytorch.py
- modeling_dpr.py
- modeling_tf_dpr.py
- tokenization_dpr.py
- tokenization_dpr_fast.py
- __init__.py
- configuration_electra.py
- convert_electra_original_tf_checkpoint_to_pytorch.py
- modeling_electra.py
- modeling_tf_electra.py
- tokenization_electra.py
- tokenization_electra_fast.py
- __init__.py
- configuration_encoder_decoder.py
- modeling_encoder_decoder.py
- __init__.py
- configuration_flaubert.py
- modeling_flaubert.py
- modeling_tf_flaubert.py
- tokenization_flaubert.py
- __init__.py
- configuration_fsmt.py
- convert_fsmt_original_pytorch_checkpoint_to_pytorch.py
- modeling_fsmt.py
- tokenization_fsmt.py
- __init__.py
- configuration_funnel.py
- convert_funnel_original_tf_checkpoint_to_pytorch.py
- modeling_funnel.py
- modeling_tf_funnel.py
- tokenization_funnel.py
- tokenization_funnel_fast.py
- __init__.py
- configuration_gpt2.py
- convert_gpt2_original_tf_checkpoint_to_pytorch.py
- modeling_gpt2.py
- modeling_tf_gpt2.py
- tokenization_gpt2.py
- tokenization_gpt2_fast.py
- __init__.py
- tokenization_herbert.py
- tokenization_herbert_fast.py
- __init__.py
- configuration_layoutlm.py
- modeling_layoutlm.py
- tokenization_layoutlm.py
- tokenization_layoutlm_fast.py
- __init__.py
- configuration_longformer.py
- convert_longformer_original_pytorch_lightning_to_pytorch.py
- modeling_longformer.py
- modeling_tf_longformer.py
- tokenization_longformer.py
- tokenization_longformer_fast.py
- __init__.py
- configuration_lxmert.py
- convert_lxmert_original_tf_checkpoint_to_pytorch.py
- modeling_lxmert.py
- modeling_tf_lxmert.py
- tokenization_lxmert.py
- tokenization_lxmert_fast.py
- __init__.py
- configuration_marian.py
- convert_marian_tatoeba_to_pytorch.py
- convert_marian_to_pytorch.py
- modeling_marian.py
- modeling_tf_marian.py
- tokenization_marian.py
- __init__.py
- configuration_mbart.py
- convert_mbart_original_checkpoint_to_pytorch.py
- modeling_mbart.py
- modeling_tf_mbart.py
- tokenization_mbart.py
- tokenization_mbart_fast.py
- __init__.py
- configuration_mmbt.py
- modeling_mmbt.py
- __init__.py
- configuration_mobilebert.py
- convert_mobilebert_original_tf_checkpoint_to_pytorch.py
- modeling_mobilebert.py
- modeling_tf_mobilebert.py
- tokenization_mobilebert.py
- tokenization_mobilebert_fast.py
- __init__.py
- configuration_mpnet.py
- modeling_mpnet.py
- modeling_tf_mpnet.py
- tokenization_mpnet.py
- tokenization_mpnet_fast.py
- __init__.py
- configuration_mt5.py
- modeling_mt5.py
- modeling_tf_mt5.py
- __init__.py
- configuration_openai.py
- convert_openai_original_tf_checkpoint_to_pytorch.py
- modeling_openai.py
- modeling_tf_openai.py
- tokenization_openai.py
- tokenization_openai_fast.py
- __init__.py
- configuration_pegasus.py
- convert_pegasus_tf_to_pytorch.py
- modeling_pegasus.py
- modeling_tf_pegasus.py
- tokenization_pegasus.py
- tokenization_pegasus_fast.py
- __init__.py
- tokenization_phobert.py
- __init__.py
- configuration_prophetnet.py
- convert_prophetnet_original_pytorch_checkpoint_to_pytorch.py
- modeling_prophetnet.py
- tokenization_prophetnet.py
- __init__.py
- configuration_rag.py
- modeling_rag.py
- retrieval_rag.py
- tokenization_rag.py
- __init__.py
- configuration_reformer.py
- convert_reformer_trax_checkpoint_to_pytorch.py
- modeling_reformer.py
- tokenization_reformer.py
- tokenization_reformer_fast.py
- __init__.py
- configuration_retribert.py
- modeling_retribert.py
- tokenization_retribert.py
- tokenization_retribert_fast.py
- __init__.py
- configuration_roberta.py
- convert_roberta_original_pytorch_checkpoint_to_pytorch.py
- modeling_flax_roberta.py
- modeling_roberta.py
- modeling_tf_roberta.py
- tokenization_roberta.py
- tokenization_roberta_fast.py
- __init__.py
- configuration_squeezebert.py
- modeling_squeezebert.py
- tokenization_squeezebert.py
- tokenization_squeezebert_fast.py
- __init__.py
- configuration_t5.py
- convert_t5_original_tf_checkpoint_to_pytorch.py
- modeling_t5.py
- modeling_tf_t5.py
- tokenization_t5.py
- tokenization_t5_fast.py
- __init__.py
- configuration_tapas.py
- convert_tapas_original_tf_checkpoint_to_pytorch.py
- modeling_tapas.py
- tokenization_tapas.py
- __init__.py
- configuration_transfo_xl.py
- convert_transfo_xl_original_tf_checkpoint_to_pytorch.py
- modeling_tf_transfo_xl.py
- modeling_tf_transfo_xl_utilities.py
- modeling_transfo_xl.py
- modeling_transfo_xl_utilities.py
- tokenization_transfo_xl.py
- __init__.py
- configuration_xlm.py
- convert_xlm_original_pytorch_checkpoint_to_pytorch.py
- modeling_tf_xlm.py
- modeling_xlm.py
- tokenization_xlm.py
- __init__.py
- configuration_xlm_prophetnet.py
- modeling_xlm_prophetnet.py
- tokenization_xlm_prophetnet.py
- __init__.py
- configuration_xlm_roberta.py
- modeling_tf_xlm_roberta.py
- modeling_xlm_roberta.py
- tokenization_xlm_roberta.py
- tokenization_xlm_roberta_fast.py
- __init__.py
- configuration_xlnet.py
- convert_xlnet_original_tf_checkpoint_to_pytorch.py
- modeling_tf_xlnet.py
- modeling_xlnet.py
- tokenization_xlnet.py
- tokenization_xlnet_fast.py
- __init__.py
- __init__.py
- dummy_flax_objects.py
- dummy_pt_objects.py
- dummy_sentencepiece_objects.py
- dummy_tf_objects.py
- dummy_tokenizers_objects.py
- hp_naming.py
- logging.py
- model_parallel_utils.py
- notebook.py
- sentencepiece_model_pb2.py
- versions.py
- __init__.py
- activations.py
- activations_tf.py
- configuration_utils.py
- convert_graph_to_onnx.py
- convert_pytorch_checkpoint_to_tf2.py
- convert_slow_tokenizer.py
- convert_slow_tokenizers_checkpoints_to_fast.py
- convert_tf_hub_seq_to_seq_bert_to_pytorch.py
- dependency_versions_check.py
- dependency_versions_table.py
- file_utils.py
- generation_beam_search.py
- generation_logits_process.py
- generation_tf_utils.py
- generation_utils.py
- hf_api.py
- hf_argparser.py
- integrations.py
- modelcard.py
- modeling_flax_utils.py
- modeling_outputs.py
- modeling_tf_outputs.py
- modeling_tf_pytorch_utils.py
- modeling_tf_utils.py
- modeling_utils.py
- optimization.py
- optimization_tf.py
- pipelines.py
- testing_utils.py
- tokenization_utils.py
- tokenization_utils_base.py
- tokenization_utils_fast.py
- trainer.py
- trainer_callback.py
- trainer_pt_utils.py
- trainer_seq2seq.py
- trainer_tf.py
- trainer_utils.py
- training_args.py
- training_args_seq2seq.py
- training_args_tf.py
- run_{{cookiecutter.example_shortcut}}.py
- cookiecutter.json
- README.md
- __init__.py
- configuration.json
- configuration_{{cookiecutter.lowercase_modelname}}.py
- modeling_tf_{{cookiecutter.lowercase_modelname}}.py
- modeling_{{cookiecutter.lowercase_modelname}}.py
- test_modeling_tf_{{cookiecutter.lowercase_modelname}}.py
- test_modeling_{{cookiecutter.lowercase_modelname}}.py
- to_replace_{{cookiecutter.lowercase_modelname}}.py
- tokenization_fast_{{cookiecutter.lowercase_modelname}}.py
- tokenization_{{cookiecutter.lowercase_modelname}}.py
- {{cookiecutter.lowercase_modelname}}.rst
- encoder-bert-tokenizer.json
- pt-encoder-bert-tokenizer.json
- pt-seq-2-seq-bart-tokenizer.json
- standalone.json
- tf-encoder-bert-tokenizer.json
- tf-seq-2-seq-bart-tokenizer.json
- cookiecutter.json
- README.md
- sample_text_no_unicode.txt
- __init__.py
- conftest.py
- test_activations.py
- test_activations_tf.py
- test_benchmark.py
- test_benchmark_tf.py
- test_cli.py
- test_configuration_auto.py
- test_configuration_common.py
- test_data_collator.py
- test_doc_samples.py
- test_file_utils.py
- test_flax_auto.py
- test_generation_beam_search.py
- test_generation_logits_process.py
- test_generation_utils.py
- test_hf_api.py
- test_hf_argparser.py
- test_logging.py
- test_model_card.py
- test_model_output.py
- test_modeling_albert.py
- test_modeling_auto.py
- test_modeling_bart.py
- test_modeling_bert.py
- test_modeling_bert_generation.py
- test_modeling_blenderbot.py
- test_modeling_camembert.py
- test_modeling_common.py
- test_modeling_ctrl.py
- test_modeling_deberta.py
- test_modeling_distilbert.py
- test_modeling_dpr.py
- test_modeling_electra.py
- test_modeling_encoder_decoder.py
- test_modeling_flaubert.py
- test_modeling_flax_bert.py
- test_modeling_flax_common.py
- test_modeling_flax_roberta.py
- test_modeling_fsmt.py
- test_modeling_funnel.py
- test_modeling_gpt2.py
- test_modeling_layoutlm.py
- test_modeling_longformer.py
- test_modeling_lxmert.py
- test_modeling_marian.py
- test_modeling_mbart.py
- test_modeling_mobilebert.py
- test_modeling_mpnet.py
- test_modeling_mt5.py
- test_modeling_openai.py
- test_modeling_pegasus.py
- test_modeling_prophetnet.py
- test_modeling_rag.py
- test_modeling_reformer.py
- test_modeling_roberta.py
- test_modeling_squeezebert.py
- test_modeling_t5.py
- test_modeling_tapas.py
- test_modeling_tf_albert.py
- test_modeling_tf_auto.py
- test_modeling_tf_bart.py
- test_modeling_tf_bert.py
- test_modeling_tf_blenderbot.py
- test_modeling_tf_camembert.py
- test_modeling_tf_common.py
- test_modeling_tf_ctrl.py
- test_modeling_tf_distilbert.py
- test_modeling_tf_dpr.py
- test_modeling_tf_electra.py
- test_modeling_tf_flaubert.py
- test_modeling_tf_funnel.py
- test_modeling_tf_gpt2.py
- test_modeling_tf_longformer.py
- test_modeling_tf_lxmert.py
- test_modeling_tf_marian.py
- test_modeling_tf_mbart.py
- test_modeling_tf_mobilebert.py
- test_modeling_tf_mpnet.py
- test_modeling_tf_mt5.py
- test_modeling_tf_openai.py
- test_modeling_tf_pegasus.py
- test_modeling_tf_pytorch.py
- test_modeling_tf_roberta.py
- test_modeling_tf_t5.py
- test_modeling_tf_transfo_xl.py
- test_modeling_tf_xlm.py
- test_modeling_tf_xlm_roberta.py
- test_modeling_tf_xlnet.py
- test_modeling_transfo_xl.py
- test_modeling_xlm.py
- test_modeling_xlm_prophetnet.py
- test_modeling_xlm_roberta.py
- test_modeling_xlnet.py
- test_onnx.py
- test_optimization.py
- test_optimization_tf.py
- test_pipelines_common.py
- test_pipelines_conversational.py
- test_pipelines_feature_extraction.py
- test_pipelines_fill_mask.py
- test_pipelines_ner.py
- test_pipelines_question_answering.py
- test_pipelines_sentiment_analysis.py
- test_pipelines_summarization.py
- test_pipelines_table_question_answering.py
- test_pipelines_text2text_generation.py
- test_pipelines_text_generation.py
- test_pipelines_translation.py
- test_pipelines_zero_shot.py
- test_retrieval_rag.py
- test_skip_decorators.py
- test_tokenization_albert.py
- test_tokenization_auto.py
- test_tokenization_bart.py
- test_tokenization_barthez.py
- test_tokenization_bert.py
- test_tokenization_bert_generation.py
- test_tokenization_bert_japanese.py
- test_tokenization_bertweet.py
- test_tokenization_blenderbot.py
- test_tokenization_camembert.py
- test_tokenization_common.py
- test_tokenization_ctrl.py
- test_tokenization_deberta.py
- test_tokenization_distilbert.py
- test_tokenization_dpr.py
- test_tokenization_fsmt.py
- test_tokenization_funnel.py
- test_tokenization_gpt2.py
- test_tokenization_herbert.py
- test_tokenization_layoutlm.py
- test_tokenization_lxmert.py
- test_tokenization_marian.py
- test_tokenization_mbart.py
- test_tokenization_mpnet.py
- test_tokenization_openai.py
- test_tokenization_pegasus.py
- test_tokenization_phobert.py
- test_tokenization_prophetnet.py
- test_tokenization_rag.py
- test_tokenization_reformer.py
- test_tokenization_roberta.py
- test_tokenization_squeezebert.py
- test_tokenization_t5.py
- test_tokenization_tapas.py
- test_tokenization_transfo_xl.py
- test_tokenization_utils.py
- test_tokenization_xlm.py
- test_tokenization_xlm_prophetnet.py
- test_tokenization_xlm_roberta.py
- test_tokenization_xlnet.py
- test_trainer.py
- test_trainer_callback.py
- test_trainer_distributed.py
- test_trainer_seq2seq.py
- test_trainer_tpu.py
- test_trainer_utils.py
- test_utils_check_copies.py
- test_versions_utils.py
- check_copies.py
- check_dummies.py
- check_repo.py
- check_table.py
- download_glue_data.py
- get_modified_files.py
- link_tester.py
- style_doc.py
- .coveragerc
- .gitignore
- CODE_OF_CONDUCT.md
- CONTRIBUTING.md
- hubconf.py
- LICENSE
- Makefile
- MANIFEST.in
- pyproject.toml
- README.md
- setup.cfg
- setup.py
- valohai.yaml
- __init__.py
- distributed_trainer.sh
- evaluate.sh
- extract_data.py
- job.sh
- pipeline.py
- README.md
- requirements.txt
- sentence_splitter.py
- setup.sh
- trainer.sh
- utils.py
- .gitignore
- README.md
// repository documentation
Was this content helpful?
(0 ratings)