DeepPavlov
An open source library for deep learning end-to-end dialog systems and chatbots.
File Explorer
Download Latest Version (.zip)- bug_report.md
- config.yml
- feature-request.md
- default.html
- glue_cola_roberta.json
- glue_mnli_cased_bert_torch.json
- glue_mnli_mm_cased_bert_torch.json
- glue_mnli_roberta.json
- glue_mrpc_roberta.json
- glue_qnli_roberta.json
- glue_qqp_roberta.json
- glue_rte_cased_bert_torch.json
- glue_rte_roberta_mnli.json
- glue_sst2_roberta.json
- glue_stsb_roberta.json
- glue_wnli_roberta.json
- superglue_boolq_roberta_mnli.json
- superglue_copa_roberta.json
- superglue_record_roberta.json
- superglue_wic_bert.json
- boolqa_rubert.json
- few_shot_roberta.json
- insults_kaggle_bert.json
- paraphraser_convers_distilrubert_2L.json
- paraphraser_convers_distilrubert_6L.json
- paraphraser_rubert.json
- query_pr.json
- rusentiment_bert.json
- rusentiment_convers_bert.json
- rusentiment_convers_distilrubert_2L.json
- rusentiment_convers_distilrubert_6L.json
- sentiment_sst_conv_bert.json
- sentiment_twitter.json
- topics_distilbert_base_uncased.json
- en_ranker_pop_wiki.json
- en_ranker_tfidf_wiki.json
- ru_ranker_tfidf_wiki.json
- bert_embedder.json
- bert_sentence_embedder.json
- entity_detection_en.json
- entity_detection_ru.json
- entity_extraction_en.json
- entity_extraction_ru.json
- entity_linking_en.json
- entity_linking_ru.json
- fasttext_logreg.json
- kbqa_cq_en.json
- kbqa_cq_ru.json
- wiki_parser.json
- morpho_ru_syntagrus_bert.json
- ru_syntagrus_joint_parsing.json
- syntax_ru_syntagrus_bert.json
- mt_glue.json
- multitask_example.json
- ner_bert_base.json
- ner_case_agnostic_mdistilbert.json
- ner_collection3_bert.json
- ner_conll2003_bert.json
- ner_conll2003_deberta_crf.json
- ner_ontonotes_bert.json
- ner_ontonotes_bert_mult.json
- ner_ontonotes_deberta_crf.json
- ner_rus_bert.json
- ner_rus_bert_probas.json
- ner_rus_convers_distilrubert_2L.json
- ner_rus_convers_distilrubert_6L.json
- en_odqa_infer_wiki.json
- en_odqa_pop_infer_wiki.json
- ru_odqa_infer_wiki.json
- path_ranking_nll_roberta_en.json
- ranking_ubuntu_v2_torch_bert_uncased.json
- rel_ranking_nll_bert_ru.json
- rel_ranking_roberta_en.json
- translation_ranker.json
- re_docred.json
- re_rured.json
- russian_superglue_danetqa_rubert.json
- russian_superglue_lidirus_rubert.json
- russian_superglue_muserc_rubert.json
- russian_superglue_parus_rubert.json
- russian_superglue_rcb_rubert.json
- russian_superglue_rucos_rubert.json
- russian_superglue_russe_rubert.json
- russian_superglue_rwsd_rubert.json
- russian_superglue_terra_rubert.json
- sentseg_dailydialog_bert.json
- brillmoore_wikitypos_en.json
- levenshtein_corrector_ru.json
- qa_multisberquad_bert.json
- qa_nq_psgcls_bert.json
- qa_squad2_bert.json
- squad_bert.json
- squad_ru_bert.json
- squad_ru_convers_distilrubert_2L.json
- squad_ru_convers_distilrubert_6L.json
- __init__.py
- __init__.py
- infer.py
- train.py
- utils.py
- __init__.py
- aliases.py
- base.py
- chainer.py
- cross_validation.py
- errors.py
- file.py
- log.py
- log_events.py
- metrics_registry.json
- metrics_registry.py
- params.py
- params_search.py
- paths.py
- prints.py
- registry.json
- registry.py
- requirements_registry.json
- __init__.py
- data_fitting_iterator.py
- data_learning_iterator.py
- dataset_reader.py
- simple_vocab.py
- utils.py
- __init__.py
- component.py
- estimator.py
- nn_model.py
- serializable.py
- torch_model.py
- __init__.py
- fit_trainer.py
- nn_trainer.py
- torch_trainer.py
- utils.py
- __init__.py
- __init__.py
- basic_classification_iterator.py
- huggingface_dataset_iterator.py
- morphotagger_iterator.py
- multitask_iterator.py
- siamese_iterator.py
- sqlite_iterator.py
- squad_iterator.py
- typos_iterator.py
- __init__.py
- basic_classification_reader.py
- boolqa_reader.py
- conll2003_reader.py
- docred_reader.py
- faq_reader.py
- huggingface_dataset_reader.py
- imdb_reader.py
- line_reader.py
- morphotagging_dataset_reader.py
- multitask_reader.py
- odqa_reader.py
- paraphraser_reader.py
- rel_ranking_reader.py
- rured_reader.py
- sq_reader.py
- squad_dataset_reader.py
- typos_reader.py
- ubuntu_v2_reader.py
- __init__.py
- accuracy.py
- bleu.py
- correlation.py
- elmo_metrics.py
- fmeasure.py
- google_bleu.py
- log_loss.py
- mse.py
- recall_at_k.py
- record_metrics.py
- roc_auc_score.py
- squad_metrics.py
- __init__.py
- api_requester.py
- api_router.py
- __init__.py
- cos_sim_classifier.py
- dnnc_proba2labels.py
- proba2labels.py
- re_bert.py
- torch_classification_model.py
- torch_nets.py
- utils.py
- __init__.py
- bpr.py
- logit_ranker.py
- pop_ranker.py
- tfidf_ranker.py
- utils.py
- __init__.py
- abstract_embedder.py
- fasttext_embedder.py
- tfidf_weighted_embedder.py
- transformers_embedder.py
- __init__.py
- entity_detection_parser.py
- entity_linking.py
- find_word.py
- ner_chunker.py
- __init__.py
- query_generator.py
- query_generator_base.py
- rel_ranking_infer.py
- ru_adj_to_noun.py
- sentence_answer.py
- template_matcher.py
- tree_to_sparql.py
- type_define.py
- utils.py
- wiki_parser.py
- __init__.py
- dependency_decoding.py
- joint.py
- spacy_lemmatizer.py
- syntax_parsing.py
- __init__.py
- dirty_comments_preprocessor.py
- dnnc_preprocessor.py
- mask.py
- multitask_preprocessor.py
- ner_preprocessor.py
- odqa_preprocessors.py
- one_hotter.py
- re_preprocessor.py
- response_base_loader.py
- sanitizer.py
- sentseg_preprocessor.py
- squad_preprocessor.py
- str_lower.py
- str_token_reverser.py
- str_utf8_encoder.py
- torch_transformers_preprocessor.py
- transformers_preprocessor.py
- __init__.py
- metrics.py
- __init__.py
- losses.py
- relation_extraction_bert.py
- __init__.py
- sklearn_component.py
- __init__.py
- error_model.py
- __init__.py
- kenlm_elector.py
- top1_elector.py
- __init__.py
- levenshtein_searcher.py
- searcher_component.py
- tabled_trie.py
- __init__.py
- __init__.py
- lazy_tokenizer.py
- nltk_moses_tokenizer.py
- nltk_tokenizer.py
- spacy_tokenizer.py
- split_tokenizer.py
- utils.py
- __init__.py
- crf.py
- multitask_transformer.py
- torch_bert_ranker.py
- torch_transformers_classifier.py
- torch_transformers_el_ranker.py
- torch_transformers_multiplechoice.py
- torch_transformers_nll_ranking.py
- torch_transformers_sequence_tagger.py
- torch_transformers_squad.py
- torch_transformers_syntax_parser.py
- __init__.py
- hashing_tfidf_vectorizer.py
- __init__.py
- datasets.txt
- dependency_decoding.txt
- en_core_web_sm.txt
- faiss.txt
- fasttext.txt
- hdt.txt
- kenlm.txt
- lxml.txt
- opt_einsum.txt
- protobuf.txt
- pytorch.txt
- rapidfuzz.txt
- razdel.txt
- ru_core_news_sm.txt
- sacremoses.txt
- sentencepiece.txt
- slovnet.txt
- sortedcontainers.txt
- torchcrf.txt
- transformers.txt
- udapi.txt
- whapi.txt
- __init__.py
- benchmarks.py
- __init__.py
- dialog_logger.py
- __init__.py
- pip_wrapper.py
- __init__.py
- metrics.py
- server.py
- __init__.py
- dialog_logger_config.json
- log_config.json
- server_config.json
- __init__.py
- socket.py
- __init__.py
- __init__.py
- typos.py
- wiki_sqlite.py
- __init__.py
- __main__.py
- _meta.py
- deep.py
- download.py
- paramsearch.py
- settings.py
- 01_login_to_aws.png
- 02_choose_ubuntu.png
- 03_select_instance_type.png
- 04_add_storage.png
- 05_review_instance.png
- 06_go_to_running_instances.png
- 07_wait_init.png
- 08_01_set_sec_group.png
- 08_02_set_inbound.png
- 09_01_select_connect.png
- 09_02_connection_info.png
- Medium_Monogram.svg
- telegram.png
- Twitter_Social_Icon_Circle_Color.svg
- youtube_social_circle_red.png
- deeppavlov.css
- deeppavlov.png
- deeppavlov_logo.png
- dp_agnt_diag.png
- gobot_diagram.png
- ipavlov_footer.png
- kvret_diagram.png
- my_blocks.css
- tree.png
- footer.html
- commands.rst
- common.rst
- data.rst
- models.rst
- trainers.rst
- api_requester.rst
- classifiers.rst
- doc_retrieval.rst
- embedders.rst
- entity_extraction.rst
- kbqa.rst
- preprocessors.rst
- relation_extraction.rst
- sklearn.rst
- spelling_correction.rst
- tokenizers.rst
- torch_bert.rst
- vectorizers.rst
- core.rst
- dataset_iterators.rst
- dataset_readers.rst
- metrics.rst
- models.rst
- vocabs.rst
- contribution_guide.rst
- registry.rst
- bert.rst
- classification.ipynb
- entity_extraction.ipynb
- few_shot_classification.ipynb
- KBQA.ipynb
- morpho_tagger.ipynb
- multitask_bert.rst
- NER.ipynb
- neural_ranking.ipynb
- ODQA.ipynb
- popularity_ranking.rst
- relation_extraction.ipynb
- spelling_correction.ipynb
- SQuAD.ipynb
- superglue.rst
- syntax_parser.ipynb
- tfidf_ranking.ipynb
- hypersearch.rst
- overview.rst
- pretrained_vectors.rst
- aws_ec2.rst
- rest_api.rst
- settings.rst
- socket_api.rst
- internships.rst
- configuration.rst
- installation.rst
- overview.rst
- python.ipynb
- quick_start.rst
- conf.py
- index.rst
- Makefile
- en_ranker_pop_wiki_test.json
- en_ranker_tfidf_wiki_test.json
- ru_ranker_tfidf_wiki_test.json
- __init__.py
- test_quick_start.py
- cmd.sh
- docker-compose.yml
- Dockerfile
- README.md
- __init__.py
- hashes.py
- optimize_ipynb.py
- registry.py
- upload.py
- __init__.py
- .gitignore
- .readthedocs.yml
- _config.yml
- CNAME
- Jenkinsfile
- LICENSE
- MANIFEST.in
- NLP_OSS_DeepPavlov_ACL_Demo_final.pdf
- README.md
- requirements.txt
- setup.py
๐ Installation Guide
1. Get the code
git clone https://github.com/deeppavlov/DeepPavlov
Downloads the entire project code from GitHub to your computer.
cd DeepPavlov
Moves into the project folder you just downloaded.
2. Official Install Script
Easy RecommendedPrerequisites
- Python 3 Python is required to use pip.
pip install deeppavlov
Installs the package published on PyPI directly โ no need to clone the source.
After installing, open a new terminal and run the program's version command (e.g. --version) to confirm it worked.
Pulled directly from this repo's README.
3. Docker
EasyPrerequisites
- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker compose -f utils/Docker/docker-compose.yml up -d --build
Runs the command against the services defined in the compose file.
Run docker compose ps to check the containers are Up. If the README mentions a port, open http://localhost:PORT in your browser.
4. Python
EasyPrerequisites
python -m venv env
Runs the Python script (or module).
pip install deeppavlov
Installs the package published on PyPI directly โ no need to clone the source.
python -m deeppavlov interact <config_path> [-d] [-i]
Runs the Python script (or module).
python -m deeppavlov train <config_path> [-d] [-i]
Runs the Python script (or module).
python -m deeppavlov <action> <config_path> [-d] [-i]
Runs the Python script (or module).
If it runs without errors and prints output in the terminal, it worked.
Pulled directly from this repo's README.
5. Make
MediumPrerequisites
- Git Needed to download the project code from GitHub.
- Make Usually pre-installed on Linux/macOS. On Windows, install separately (e.g. via MSYS2 or WSL).
cd docs
This project's files live in a subfolder, so move into it first.
make
Compiles the code based on the generated build configuration to produce an executable.
If it finishes without errors, it worked. Try running the generated executable directly.
// repository documentation
Was this content helpful?
(0 ratings)