allennlp
PyTorch 기반의 오픈소스 NLP 연구 라이브러리입니다.
파일 탐색기
최종 버전 다운로드 (.zip)- bug_report.md
- feature_request.md
- question.md
- cffconvert.yml
- ci.yml
- issues.yml
- pull_request_template.md
- __init__.py
- _checklist_internal.py
- build_vocab.py
- cached_path.py
- checklist.py
- count_instances.py
- diff.py
- evaluate.py
- find_learning_rate.py
- predict.py
- print_results.py
- push_to_hf.py
- subcommand.py
- test_install.py
- train.py
- __init__.py
- checklist_test.py
- confidence_check_test.py
- distributed_test.py
- interpret_test.py
- model_test_case.py
- test_case.py
- __init__.py
- cached_transformers.py
- checks.py
- file_utils.py
- from_params.py
- lazy.py
- logging.py
- meta.py
- model_card.py
- params.py
- plugins.py
- push_to_hf.py
- registrable.py
- sequences.py
- task_card.py
- tqdm.py
- util.py
- __init__.py
- question_answering_suite.py
- sentiment_analysis_suite.py
- task_suite.py
- textual_entailment_suite.py
- utils.py
- __init__.py
- normalization_bias_verification.py
- verification_base.py
- __init__.py
- data_collator.py
- data_loader.py
- multiprocess_data_loader.py
- multitask_data_loader.py
- multitask_epoch_sampler.py
- multitask_scheduler.py
- simple_data_loader.py
- __init__.py
- span_utils.py
- __init__.py
- babi.py
- conll2003.py
- dataset_reader.py
- interleaving_dataset_reader.py
- multitask.py
- sequence_tagging.py
- sharded_dataset_reader.py
- text_classification_json.py
- __init__.py
- adjacency_field.py
- array_field.py
- field.py
- flag_field.py
- index_field.py
- label_field.py
- list_field.py
- metadata_field.py
- multilabel_field.py
- namespace_swapping_field.py
- sequence_field.py
- sequence_label_field.py
- span_field.py
- tensor_field.py
- text_field.py
- transformer_text_field.py
- __init__.py
- batch_sampler.py
- bucket_batch_sampler.py
- max_tokens_batch_sampler.py
- __init__.py
- elmo_indexer.py
- pretrained_transformer_indexer.py
- pretrained_transformer_mismatched_indexer.py
- single_id_token_indexer.py
- spacy_indexer.py
- token_characters_indexer.py
- token_indexer.py
- __init__.py
- character_tokenizer.py
- letters_digits_tokenizer.py
- pretrained_transformer_tokenizer.py
- sentence_splitter.py
- spacy_tokenizer.py
- token_class.py
- tokenizer.py
- whitespace_tokenizer.py
- __init__.py
- batch.py
- image_loader.py
- instance.py
- vocabulary.py
- __init__.py
- __init__.py
- serializers.py
- __init__.py
- evaluator.py
- __init__.py
- adversarial_bias_mitigator.py
- bias_direction.py
- bias_direction_wrappers.py
- bias_metrics.py
- bias_mitigator_applicator.py
- bias_mitigator_wrappers.py
- bias_mitigators.py
- bias_utils.py
- fairness_metrics.py
- __init__.py
- attacker.py
- hotflip.py
- input_reduction.py
- utils.py
- __init__.py
- influence_interpreter.py
- simple_influence.py
- __init__.py
- integrated_gradient.py
- saliency_interpreter.py
- simple_gradient.py
- smooth_gradient.py
- __init__.py
- __init__.py
- classifier_head.py
- head.py
- __init__.py
- archival.py
- basic_classifier.py
- model.py
- multitask.py
- simple_tagger.py
- __init__.py
- additive_attention.py
- attention.py
- bilinear_attention.py
- cosine_attention.py
- dot_product_attention.py
- linear_attention.py
- scaled_dot_product_attention.py
- __init__.py
- backbone.py
- pretrained_transformer_backbone.py
- vilbert_backbone.py
- __init__.py
- conditional_random_field.py
- conditional_random_field_wemission.py
- conditional_random_field_wlannoy.py
- conditional_random_field_wtrans.py
- __init__.py
- bilinear_matrix_attention.py
- cosine_matrix_attention.py
- dot_product_matrix_attention.py
- linear_matrix_attention.py
- matrix_attention.py
- scaled_dot_product_matrix_attention.py
- __init__.py
- compose_encoder.py
- feedforward_encoder.py
- gated_cnn_encoder.py
- pass_through_encoder.py
- pytorch_seq2seq_wrapper.py
- pytorch_transformer_wrapper.py
- seq2seq_encoder.py
- __init__.py
- bert_pooler.py
- boe_encoder.py
- cls_pooler.py
- cnn_encoder.py
- cnn_highway_encoder.py
- pytorch_seq2vec_wrapper.py
- seq2vec_encoder.py
- __init__.py
- bidirectional_endpoint_span_extractor.py
- endpoint_span_extractor.py
- max_pooling_span_extractor.py
- self_attentive_span_extractor.py
- span_extractor.py
- span_extractor_with_span_width_embedding.py
- __init__.py
- basic_text_field_embedder.py
- text_field_embedder.py
- __init__.py
- bag_of_word_counts_token_embedder.py
- elmo_token_embedder.py
- embedding.py
- empty_embedder.py
- pass_through_token_embedder.py
- pretrained_transformer_embedder.py
- pretrained_transformer_mismatched_embedder.py
- token_characters_encoder.py
- token_embedder.py
- __init__.py
- activation_layer.py
- attention_module.py
- bimodal_attention.py
- bimodal_connection_layer.py
- bimodal_encoder.py
- layer_norm.py
- output_layer.py
- positional_encoding.py
- t5.py
- transformer_embeddings.py
- transformer_layer.py
- transformer_module.py
- transformer_pooler.py
- transformer_stack.py
- util.py
- __init__.py
- grid_embedder.py
- image2image.py
- region_detector.py
- __init__.py
- augmented_lstm.py
- bimpm_matching.py
- elmo.py
- elmo_lstm.py
- encoder_base.py
- feedforward.py
- gated_sum.py
- highway.py
- input_variational_dropout.py
- layer_norm.py
- lstm_cell_with_projection.py
- masked_layer_norm.py
- maxout.py
- residual_with_layer_dropout.py
- sampled_softmax_loss.py
- scalar_mix.py
- softmax_loss.py
- stacked_alternating_lstm.py
- stacked_bidirectional_lstm.py
- time_distributed.py
- util.py
- __init__.py
- checkpoint_wrapper.py
- fairscale_checkpoint_wrapper.py
- __init__.py
- ddp_accelerator.py
- fairscale_fsdp_accelerator.py
- sharded_module_mixin.py
- __init__.py
- regularizer.py
- regularizer_applicator.py
- regularizers.py
- __init__.py
- activations.py
- beam_search.py
- chu_liu_edmonds.py
- initializers.py
- module.py
- util.py
- __init__.py
- multitask.py
- predictor.py
- sentence_tagger.py
- text_classifier.py
- __init__.py
- __init__.py
- bug.gld
- bug.rsl-new
- bug.rsl-old
- bug.tst
- sample.gld
- sample.prm
- sample.rsl
- sample.tst
- .gitignore
- COLLINS.prm
- evalb.c
- LICENSE
- Makefile
- new.prm
- README
- tgrep_proc.prl
- __init__.py
- archive_surgery.py
- create_elmo_embeddings_from_vocab.py
- inspect_cache.py
- __init__.py
- backward.py
- callback.py
- confidence_checks.py
- console_logger.py
- log_writer.py
- should_validate.py
- tensorboard.py
- track_epoch.py
- wandb.py
- __init__.py
- combined.py
- cosine.py
- learning_rate_scheduler.py
- linear_with_warmup.py
- noam.py
- polynomial_decay.py
- pytorch_lr_schedulers.py
- slanted_triangular.py
- __init__.py
- attachment_scores.py
- auc.py
- average.py
- bleu.py
- boolean_accuracy.py
- categorical_accuracy.py
- covariance.py
- entropy.py
- evalb_bracketing_scorer.py
- f1_measure.py
- fbeta_measure.py
- fbeta_multi_label_measure.py
- fbeta_verbose_measure.py
- mean_absolute_error.py
- metric.py
- pearson_correlation.py
- perplexity.py
- rouge.py
- sequence_accuracy.py
- span_based_f1_measure.py
- spearman_correlation.py
- unigram_recall.py
- __init__.py
- inverted_triangular.py
- momentum_scheduler.py
- __init__.py
- checkpointer.py
- gradient_descent_trainer.py
- metric_tracker.py
- moving_average.py
- no_op_trainer.py
- optimizers.py
- scheduler.py
- trainer.py
- util.py
- __init__.py
- __main__.py
- py.typed
- version.py
- __init__.py
- character_tokenizer_bench.py
- __init__.py
- util_bench.py
- __init__.py
- pytest.ini
- extra.css
- allennlp-logo-dark.png
- favicon.ico
- resumable_train.sh
- resume_daemon.py
- run_with_beaker.py
- resume_daemon_test.py
- basic_example.py
- basic_example_expected_output.md
- py2md_test.py
- 24hr_diff.sh
- build_docs.sh
- build_docs_config.py
- check_large_files.sh
- check_links.py
- check_torch_version.py
- close_stale_issues.py
- get_version.py
- ping_issue_assignees.py
- py2md.py
- release_notes.py
- train_fixtures.py
- model.tar.gz
- model.tar.gz
- labels.txt
- non_padded_namespaces.txt
- tokens.txt
- best.th
- model.tar.gz
- common.jsonnet
- experiment_from_archive.jsonnet
- experiment_seq2seq.jsonnet
- experiment_seq2vec.jsonnet
- parameters_inspection.json
- .gitignore
- external_symlink.tar.gz
- quote.tar.gz
- COCO_train2014_000000458752.jpg
- sequence_tagging_00.tsv
- sequence_tagging_01.tsv
- sequence_tagging_02.tsv
- ag_news_corpus.jsonl
- ag_news_corpus_fake_sentiment_labels.jsonl
- imdb_corpus.jsonl
- imdb_corpus2.jsonl
- integer_labels.jsonl
- babi.txt
- brown_corpus.txt
- conll2003.txt
- sequence_tagging.tsv
- vocab.tar.gz
- vocab.zip
- characters_token_embedder.json
- elmo_token_embeddings.hdf5
- lm_embeddings_0.hdf5
- lm_embeddings_1.hdf5
- lm_embeddings_2.hdf5
- lm_weights.hdf5
- options.json
- sentences.json
- vocab_test.txt
- fake_embeddings.5d.txt
- fake_embeddings.5d.txt.bz2
- fake_embeddings.5d.txt.gz
- fake_embeddings.5d.txt.tar.gz
- fake_embeddings.5d.txt.xz
- fake_embeddings.5d.txt.zip
- glove.6B.100d.sample.txt.gz
- glove.6B.300d.sample.txt.gz
- multi-file-archive.tar.gz
- multi-file-archive.zip
- bias_embeddings.json
- definitional_pairs.json
- equalize_pairs.json
- gender_specific_full.json
- __init__.py
- d.py
- .allennlp_plugins
- labels.txt
- non_padded_namespaces.txt
- tokens.txt
- best.th
- model.tar.gz
- .lock
- labels.txt
- non_padded_namespaces.txt
- tokens.txt
- best.th
- config.json
- meta.json
- metrics.json
- metrics_epoch_0.json
- model.tar.gz
- model_state_e1_b0.th
- out.log
- training_state_e1_b0.th
- experiment.json
- experiment_with_regularization.json
- model_test_case.jsonnet
- labels.txt
- non_padded_namespaces.txt
- best.th
- model.tar.gz
- experiment.json
- labels.txt
- non_padded_namespaces.txt
- test_tokens.txt
- tokens.txt
- best.th
- model.tar.gz
- experiment.json
- fake_suite.tar.gz
- utf-8.tar.bz2
- utf-8.tar.gz
- utf-8.tar.xz
- utf-8.zip
- utf-8_sample.txt
- utf-8_sample.txt.gz
- utf-8_sample.txt.zip
- __init__.py
- __init__.py
- build_vocab_test.py
- cached_path_test.py
- checklist_test.py
- diff_test.py
- evaluate_test.py
- find_learning_rate_test.py
- main_test.py
- no_op_train_test.py
- predict_test.py
- print_results_test.py
- test_install_test.py
- train_test.py
- __init__.py
- cached_transformers_test.py
- file_utils_test.py
- from_params_test.py
- logging_test.py
- model_card_test.py
- params_test.py
- plugins_test.py
- push_to_hub_test.py
- registrable_test.py
- sequences_test.py
- task_card_test.py
- testing.py
- util_test.py
- __init__.py
- sentiment_analysis_suite_test.py
- task_suite_test.py
- utils_test.py
- normalization_bias_verification_test.py
- __init__.py
- multiprocess_data_loader_test.py
- multitask_data_loader_test.py
- multitask_scheduler_test.py
- span_utils_test.py
- __init__.py
- babi_reader_test.py
- conll2003_test.py
- dataset_reader_test.py
- interleaving_dataset_reader_test.py
- sequence_tagging_test.py
- sharded_dataset_reader_test.py
- text_classification_json_test.py
- __init__.py
- adjacency_field_test.py
- field_test.py
- flag_field_test.py
- index_field_test.py
- label_field_test.py
- list_field_test.py
- metadata_field_test.py
- multilabel_field_test.py
- sequence_label_field_test.py
- span_field_test.py
- tensor_field_test.py
- text_field_test.py
- transformer_text_field_test.py
- __init__.py
- bucket_batch_sampler_test.py
- max_tokens_batch_sampler_test.py
- sampler_test.py
- __init__.py
- character_token_indexer_test.py
- elmo_indexer_test.py
- pretrained_transformer_indexer_test.py
- pretrained_transformer_mismatched_indexer_test.py
- single_id_token_indexer_test.py
- spacy_indexer_test.py
- __init__.py
- character_tokenizer_test.py
- letters_digits_tokenizer_test.py
- pretrained_transformer_tokenizer_test.py
- sentence_splitter_test.py
- spacy_tokenizer_test.py
- __init__.py
- dataset_test.py
- image_loader_test.py
- instance_test.py
- vocabulary_test.py
- __init__.py
- serializer_test.py
- __init__.py
- evaluator_tests.py
- __init__.py
- bias_direction_test.py
- bias_metrics_test.py
- bias_mitigators_test.py
- bias_utils_test.py
- fairness_metrics_test.py
- __init__.py
- hotflip_test.py
- input_reduction_test.py
- integrated_gradient_test.py
- simple_gradient_test.py
- simple_influence_test.py
- smooth_gradient_test.py
- __init__.py
- archival_test.py
- basic_classifier_test.py
- model_test.py
- multitask_test.py
- simple_tagger_test.py
- test_model_test_case.py
- __init__.py
- additive_attention_test.py
- attention_test.py
- bilinear_attention_test.py
- cosine_attention_test.py
- dot_product_attention_test.py
- linear_attention_test.py
- scaled_dot_product_attention_test.py
- __init__.py
- bilinear_matrix_attention_test.py
- cosine_matrix_attention_test.py
- dot_product_matrix_attention_test.py
- linear_matrix_attention_test.py
- matrix_attention_test.py
- scaled_dot_product_matrix_attention_test.py
- __init__.py
- compose_encoder_test.py
- feedforward_encoder_test.py
- gated_cnn_encoder_test.py
- pass_through_encoder_test.py
- pytorch_seq2seq_wrapper_test.py
- pytorch_transformer_wrapper_test.py
- __init__.py
- bert_pooler_test.py
- boe_encoder_test.py
- cls_pooler_test.py
- cnn_encoder_test.py
- cnn_highway_encoder_test.py
- pytorch_seq2vec_wrapper_test.py
- __init__.py
- bidirectional_endpoint_span_extractor_test.py
- endpoint_span_extractor_test.py
- max_pooling_span_extractor_test.py
- self_attentive_span_extractor_test.py
- __init__.py
- basic_text_field_embedder_test.py
- __init__.py
- bag_of_word_counts_token_embedder_test.py
- elmo_token_embedder_test.py
- embedding_test.py
- pass_through_embedder_test.py
- pretrained_transformer_embedder_test.py
- pretrained_transformer_mismatched_embedder_test.py
- token_characters_encoder_test.py
- activation_layer_test.py
- bimodal_attention_test.py
- bimodal_encoder_test.py
- output_layer_test.py
- positional_encoding_test.py
- self_attention_test.py
- t5_self_attention_test.py
- t5_test.py
- toolkit_test.py
- transformer_embeddings_test.py
- transformer_layer_test.py
- transformer_module_test.py
- transformer_pooler_test.py
- transformer_stack_test.py
- __init__.py
- grid_embedder_test.py
- region_detector_test.py
- augmented_lstm_test.py
- bimpm_matching_test.py
- conditional_random_field_test.py
- elmo_test.py
- encoder_base_test.py
- feedforward_test.py
- gated_sum_test.py
- highway_test.py
- lstm_cell_with_projection_test.py
- masked_layer_norm_test.py
- maxout_test.py
- residual_with_layer_dropout_test.py
- sampled_softmax_loss_test.py
- scalar_mix_test.py
- seq2seq_encoder_test.py
- seq2vec_encoder_test.py
- stacked_alternating_lstm_test.py
- stacked_bidirectional_lstm_test.py
- stacked_elmo_lstm_test.py
- time_distributed_test.py
- __init__.py
- checkpoint_wrapper_test.py
- fairscale_checkpoint_wrapper_test.py
- __init__.py
- fairscale_fsdp_accelerator_test.py
- __init__.py
- beam_search_test.py
- chu_liu_edmonds_test.py
- initializers_test.py
- pretrained_model_initializer_test.py
- regularizers_test.py
- util_test.py
- __init__.py
- predictor_test.py
- sentence_tagger_test.py
- text_classifier_test.py
- __init__.py
- combined_test.py
- cosine_test.py
- learning_rate_scheduler_test.py
- slanted_triangular_test.py
- __init__.py
- attachment_scores_test.py
- auc_test.py
- average_test.py
- bleu_test.py
- boolean_accuracy_test.py
- categorical_accuracy_test.py
- covariance_test.py
- entropy_test.py
- evalb_bracketing_scorer_test.py
- f1_measure_test.py
- fbeta_measure_test.py
- fbeta_multi_label_measure_test.py
- fbeta_verbose_measure_test.py
- mean_absolute_error_test.py
- pearson_correlation_test.py
- rouge_test.py
- sequence_accuracy_test.py
- span_based_f1_measure_test.py
- spearman_correlation_test.py
- unigram_recall_test.py
- __init__.py
- inverted_triangular_test.py
- __init__.py
- checkpointer_test.py
- moving_average_test.py
- no_op_trainer_test.py
- optimizer_test.py
- trainer_test.py
- util_test.py
- __init__.py
- basic_allennlp_test.py
- __init__.py
- __init__.py
- version_test.py
- .coveragerc
- .dockerignore
- .flake8
- .gitignore
- CHANGELOG.md
- CITATION.cff
- codecov.yml
- constraints.txt
- CONTRIBUTING.md
- dev-requirements.txt
- Dockerfile
- Dockerfile.test
- LICENSE
- Makefile
- MANIFEST.in
- mkdocs-skeleton.yml
- mypy.ini
- pyproject.toml
- pytest.ini
- README.md
- RELEASE_PROCESS.md
- requirements.in
- requirements.txt
- setup.py
- STYLE.md
# 설치 가이드
git clone https://github.com/allenai/allennlp
깃허브에서 프로젝트 코드 전체를 내 컴퓨터로 내려받습니다.
cd allennlp
방금 내려받은 프로젝트 폴더 안으로 이동합니다.
2. 공식 설치 스크립트
쉬움 추천- Python 3 pip 명령어를 쓰려면 Python이 필요합니다.
pip install allennlp
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install allennlp[checklist]
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install allennlp-models
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install -U pip setuptools wheel
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.
3. Docker
쉬움- Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
- Docker Desktop 컨테이너를 빌드하고 실행하려면 필요합니다. 설치 후 실행해서 백그라운드에 켜두세요.
docker run --rm --gpus all -v $HOME/.allennlp:/root/.allennlp allennlp/allennlp:latest
빌드된 이미지를 실제 컨테이너로 실행합니다.
docker run --rm --gpus all -v $HOME/.allennlp:/root/.allennlp allennlp/allennlp:latest test-install
빌드된 이미지를 실제 컨테이너로 실행합니다.
- [Installing using Docker](#installing-using-docker)
이 명령어를 터미널에 그대로 입력해 실행하세요.
이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.
4. Python
쉬움pip install allennlp
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install allennlp[checklist]
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install allennlp-models
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install -U pip setuptools wheel
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
pip install --editable .[dev,all]
PyPI에 배포된 패키지를 바로 설치합니다. 소스 클론이 필요 없습니다.
이 레포의 README에 적힌 실제 명령어를 그대로 가져왔습니다.
5. Make
보통- Git GitHub에서 프로젝트 코드를 내려받으려면 필요합니다.
- Make Linux/macOS는 보통 기본 설치되어 있습니다. Windows는 별도 설치(예: MSYS2, WSL)가 필요합니다.
make
생성된 빌드 설정을 바탕으로 실제 컴파일을 진행해 실행 파일을 만듭니다.
