modernmt
Neural Adaptive Machine Translation that adapts to context and learns from corrections.
File Explorer
Download Latest Version (.zip)- __init__.py
- bleu.py
- charcut.py
- engine.py
- fileformats.py
- mmtcli.py
- processing.py
- translation.py
- __init__.py
- daemon.py
- network.py
- nvidia_smi.py
- osutils.py
- progressbar.py
- __init__.py
- cleaning.py
- create.py
- datagen.py
- evaluate.py
- memory.py
- server.py
- train.py
- translate.py
- docker-build.sh
- Dockerfile
- .gitignore
- europarl.en
- europarl.it
- ibm.en
- ibm.it
- microsoft.en
- microsoft.it
- human-eval
- javamain
- newversion
- .gitignore
- FastAlign.java
- XUtils.java
- fa_align.cpp
- fa_build.cpp
- fa_score.cpp
- alignment.h
- BidirectionalModel.cpp
- BidirectionalModel.h
- Builder.cpp
- Builder.h
- Corpus.cpp
- Corpus.h
- DiagonalAlignment.h
- FastAligner.cpp
- FastAligner.h
- ioutils.h
- Model.cpp
- Model.h
- Vocabulary.cpp
- Vocabulary.h
- alignment.h
- Corpus.h
- FastAligner.h
- Model.h
- Vocabulary.h
- eu_modernmt_aligner_fastalign_FastAlign.cpp
- jniutil.h
- SymAlignment.cpp
- SymAlignment.h
- CMakeLists.txt
- pom.xml
- Log4jConfiguration.java
- ReloadNodeDaemon.java
- BackupDaemonMain.java
- ChineseDetectMain.java
- CleaningPipelineMain.java
- ClusterNodeMain.java
- ConvertMain.java
- DeduplicationMain.java
- ExtractTMXSampleMain.java
- MemoryExportMain.java
- MergeDatasetsMain.java
- PostprocessorMain.java
- PreprocessorMain.java
- TrainingPipelineMain.java
- ValidateCorporaMain.java
- log4j-console.xml
- log4j-file.xml
- pom.xml
- Aligner.java
- AlignerException.java
- XMLAbstractBuilder.java
- XMLBinaryLogConfigBuilder.java
- XMLConfigBuilder.java
- XMLDatabaseConfigBuilder.java
- XMLEngineConfigBuilder.java
- XMLNetworkConfigBuilder.java
- AlignerConfig.java
- AnalyzerConfig.java
- ApiConfig.java
- BinaryLogConfig.java
- ConfigException.java
- DatabaseConfig.java
- DecoderConfig.java
- EngineConfig.java
- JoinConfig.java
- NetworkConfig.java
- NodeConfig.java
- ContextAnalyzer.java
- ContextAnalyzerException.java
- BinaryLog.java
- BinaryLogException.java
- DataBatch.java
- DataListenerProvider.java
- DataMessage.java
- DeletionMessage.java
- EmptyCorpusException.java
- HashGenerator.java
- HostUnreachableException.java
- LogChannel.java
- LogDataListener.java
- TranslationUnitMessage.java
- Decoder.java
- DecoderException.java
- DecoderListener.java
- DecoderUnavailableException.java
- DecoderWithNBest.java
- TranslationTimeoutException.java
- Graphics.java
- NetworkUtils.java
- BufferedLineReader.java
- ByteStream.java
- Corpora.java
- FileConst.java
- FileFormat.java
- FileProxy.java
- FileStats.java
- FileSystemUtils.java
- LineReader.java
- LineWriter.java
- Paths.java
- RuntimeIOException.java
- TokensOutputStream.java
- UnixLineReader.java
- UnixLineWriter.java
- UTF8Charset.java
- WordCounter.java
- Language.java
- LanguageBridge.java
- LanguageDirection.java
- LanguageIndex.java
- LanguagePattern.java
- LanguageRule.java
- UnsupportedLanguageException.java
- ScoreEntry.java
- TranslationMemory.java
- CompactFileCorpus.java
- FileCorpus.java
- ParallelFileCorpus.java
- LanguageCache.java
- TMXCorpus.java
- TMXReader.java
- TMXTUReader.java
- TMXWriter.java
- StringCorpus.java
- BaseCorpus.java
- BaseMultilingualCorpus.java
- Corpus.java
- CorpusWrapper.java
- LazyCorpus.java
- LazyMultilingualCorpus.java
- MaskedMultilingualCorpus.java
- MultilingualCorpus.java
- MultilingualCorpusWrapper.java
- TranslationUnit.java
- TUReader.java
- TUWriter.java
- Alignment.java
- AlignmentPoint.java
- Annotation.java
- ContextVector.java
- EmojiTag.java
- ImportJob.java
- Memory.java
- Priority.java
- Sentence.java
- SentenceUtils.java
- Tag.java
- Token.java
- Translation.java
- WhitespaceTag.java
- Word.java
- XMLTag.java
- Connection.java
- Database.java
- ImportJobDAO.java
- MemoryDAO.java
- PersistenceException.java
- DelegatingXMLStreamWriter.java
- IndentingXMLStreamWriter.java
- XMLFixInputStreamReader.java
- XMLUtils.java
- Pom.java
- RuntimeErrorException.java
- LanguageIndexTest.java
- LanguageTest.java
- pom.xml
- DefaultAnalyzer.java
- EnglishAnalyzer.java
- ItalianAnalyzer.java
- LanguageAnalyzer.java
- CosineSimilarityRescorer.java
- Rescorer.java
- ContextAnalyzerIndex.java
- CorpusAnalyzer.java
- CorpusContentField.java
- DocumentBuilder.java
- LuceneUtils.java
- Dump.java
- Bucket.java
- BucketRegistry.java
- BucketWriter.java
- CorporaStorage.java
- LuceneAnalyzer.java
- TestData.java
- TestLuceneAnalyzer_getContextVector.java
- TestLuceneAnalyzer_getContextVectorWithOwners.java
- TestLuceneAnalyzer_onDataReceived.java
- TestLuceneAnalyzer_onDelete.java
- TLuceneAnalyzer.java
- pom.xml
- AddToMemoryCorpus.java
- CreateMemory.java
- DeleteMemory.java
- GetAllMemories.java
- GetImportJob.java
- GetMemory.java
- UpdateMemories.java
- UpdateMemoryContribution.java
- GetContextVector.java
- TagsProjection.java
- Translate.java
- ContextUtils.java
- GetLanguage.java
- GetLanguages.java
- GetServerInfo.java
- HealthCheck.java
- Action.java
- CollectionAction.java
- CollectionActionResult.java
- JSONAction.java
- JSONActionResult.java
- JSONArrayAction.java
- JSONArrayActionResult.java
- JSONObjectAction.java
- JSONObjectActionResult.java
- ObjectAction.java
- ObjectActionResult.java
- VoidAction.java
- VoidActionResult.java
- Route.java
- RouterServlet.java
- RouteTemplate.java
- RouteTree.java
- TemplateException.java
- FileParameter.java
- HttpMethod.java
- JSONSerializer.java
- ParameterFileProxy.java
- Parameters.java
- RESTRequest.java
- RESTResponse.java
- ContextVectorResult.java
- ProjectedTranslation.java
- TranslationResponse.java
- AlignmentSerializer.java
- ContextVectorResultSerializer.java
- ImportJobSerializer.java
- LanguagePairSerializer.java
- LanguageSerializer.java
- TranslationResponseSerializer.java
- ApiServer.java
- MultipartConfigInjectionHandler.java
- BackupDaemon.java
- BackupEngine.java
- BackupFile.java
- FileLimitRetentionPolicy.java
- RetentionPolicy.java
- EmbeddedCassandra.java
- ClusterException.java
- FailedToJoinClusterException.java
- SystemShutdownException.java
- EmbeddedKafka.java
- KafkaBinaryLog.java
- KafkaChannel.java
- KafkaDataBatch.java
- KafkaPacket.java
- KafkaPacketDeserializer.java
- KafkaPacketSerializer.java
- LanguageCache.java
- LogDataPollingThread.java
- TranslationOperation.java
- TranslationService.java
- TranslationServiceProxy.java
- ClusterNode.java
- EmbeddedService.java
- NodeInfo.java
- ServerInfo.java
- ShutdownThread.java
- TranslationTask.java
- BootstrapException.java
- Engine.java
- AuthenticationException.java
- TestFailedException.java
- MemoryFacade.java
- ModernMT.java
- TagFacade.java
- TrainingFacade.java
- TranslationFacade.java
- CorporaPartition.java
- PartitionedLineReader.java
- PartitioningUtils.java
- PartitionWriter.java
- AsyncCorpusWriter.java
- BatchCopyProcess.java
- PreprocessingPipeline.java
- PreprocessingTask.java
- hazelcast.xml
- kafka-consumer.properties
- kafka-producer.properties
- SentenceTest.java
- DraftFilterTest.java
- MockMultilingualCorpus.java
- pom.xml
- AnalyzerFactory.java
- ContentAnalyzer.java
- CustomSimilarity.java
- DefaultAnalyzerFactory.java
- HashAnalyzer.java
- PunctuationFilter.java
- F1BleuCalculator.java
- F1BleuRescorer.java
- LevenshteinRescorer.java
- Rescorer.java
- DefaultQueryBuilder.java
- QueryBuilder.java
- Dump.java
- DefaultDocumentBuilder.java
- DocumentBuilder.java
- HashField.java
- LuceneTranslationMemory.java
- DecoderQueue.java
- DecoderQueueImpl.java
- EchoPythonDecoder.java
- EchoServerDecoderQueue.java
- Handler.java
- HandlerBlockingQueue.java
- PythonDecoder.java
- PythonDecoderImpl.java
- PythonProcess.java
- StreamPollingThread.java
- AbstractScheduler.java
- CountDownTranslationLock.java
- Scheduler.java
- SentenceBatchScheduler.java
- TranslationSplit.java
- DecoderExecutor.java
- DecoderExecutorImpl.java
- DecoderExecutorThread.java
- DecoderInitializer.java
- DefaultDecoderInitializer.java
- ModelConfig.java
- NeuralDecoder.java
- TranslationJoiner.java
- __init__.py
- alignment.py
- checkpoint.py
- decoder.py
- textencoder.py
- tuning.py
- utils.py
- __main__.py
- TestData.java
- TestLuceneTranslationMemory_hash.java
- TestLuceneTranslationMemory_onDataReceived.java
- TestLuceneTranslationMemory_onDelete.java
- TestLuceneTranslationMemory_search.java
- TestLuceneTranslationMemory_searchPrivacy.java
- TestLuceneTranslationMemory_tuUpdate.java
- TLuceneTranslationMemory.java
- pom.xml
- CassandraConnection.java
- CassandraDatabase.java
- CassandraIdGenerator.java
- CassandraImportJobDAO.java
- CassandraMemoryDAO.java
- CassandraUtils.java
- KeyspaceNotFoundException.java
- pom.xml
- create_database.sql
- SQLUtils.java
- MySQLConnection.java
- MySQLDatabase.java
- MySQLImportJobDAO.java
- MySQLMemoryDAO.java
- pom.xml
- pyflex.py
- BloomFilterCorpus.java
- BloomFilterMultilingualCorpus.java
- CorporaBloomFilter.java
- ChineseDetector.java
- DraftFilter.java
- DraftFilterData.java
- TranslationCandidate.java
- AbstractOptimaizeFilter.java
- Batch.java
- Blacklist.java
- OptimaizeLanguage.java
- OptimaizeLanguageBatchFilter.java
- OptimaizeLanguageFilter.java
- Sequence.java
- BrokenUTF8Filter.java
- EmptyLinesFilter.java
- NumericTextFilter.java
- PunctuationFilter.java
- RareNgramFilter.java
- SentenceLengthFilter.java
- TooLongLinesFilter.java
- VerbatimTranslationFilter.java
- ControlCharsStripper.java
- DeepXMLEraser.java
- StringSpacingNormalizer.java
- XMLStripper.java
- ChainedCorpusFilter.java
- ChainedMultilingualCorpusFilter.java
- CorporaCleaning.java
- CorpusFilter.java
- CorpusNormalizer.java
- FilteredCorpus.java
- FilteredMultilingualCorpus.java
- MultilingualCorpusFilter.java
- MultilingualCorpusFilterAdapter.java
- AbstractBuilder.java
- FilteredProcessorBuilder.java
- PipelineBuilder.java
- ProcessorBuilder.java
- ProcessorGroupBuilder.java
- XMLPipelineBuilder.java
- PipelineExecutor.java
- PipelineQueue.java
- CJKJoinerDetokenizer.java
- JFlexDetokenizer.java
- JFlexSpaceAnnotator.java
- SpacesAnnotatedString.java
- WhitespaceProjector.java
- ApostropheNormalizer.java
- CatalanPuntVolatNormalizer.java
- ChineseCharacterConverter.java
- ControlCharsRemover.java
- GuillemetsToQuotesProcessor.java
- ItalianAccentMarkProcessor.java
- RareCharsNormalizer.java
- WhitespacesNormalizer.java
- NumericPlaceholder.java
- NumericSequence.java
- NumericUtils.java
- Phrase.java
- NumericPlaceholderNormalizer.java
- NumericWordPostprocessor.java
- SimpleRecaser.java
- UpperCasePostprocessor.java
- UpperCasePreprocessor.java
- SentenceBreakProcessor.java
- SentenceSplit.java
- SentenceSplitter.java
- IndexMap.java
- SentenceBuilder.java
- SentenceCompiler.java
- SentenceConstructor.java
- TokenFactory.java
- Transformation.java
- XMLProjectorTestMain.java
- HtmlInputFormat.java
- InputFormat.java
- NoopInputFormat.java
- XliffInputFormat.java
- Alignment.java
- Coverage.java
- Span.java
- SpanCollection.java
- SpanTree.java
- TagCollection.java
- TagProjector.java
- EmojiTagIdentifier.java
- TagIdentifier.java
- WhitespaceTagIdentifier.java
- XMLCharacterEntity.java
- XMLEntityEscaper.java
- XMLTagIdentifier.java
- XMLTagProcessor.java
- AbbreviationAnnotator.java
- CoreNLPTokenAnnotator.java
- ArabicTokenizer.java
- ArmenianTokenizer.java
- BasqueTokenizer.java
- BretonTokenizer.java
- BulgarianTokenizer.java
- CatalanTokenizer.java
- CentralKhmerTokenizer.java
- ChineseTokenizer.java
- CzechTokenizer.java
- DanishTokenizer.java
- DefaultTokenizer.java
- DutchTokenizer.java
- EnglishTokenizer.java
- EsperantoTokenizer.java
- FarsiTokenizer.java
- FinnishTokenizer.java
- FrenchTokenizer.java
- GalicianTokenizer.java
- GermanTokenizer.java
- GreekTokenizer.java
- HebrewTokenizer.java
- HindiTokenizer.java
- HungarianTokenizer.java
- IcelandicTokenizer.java
- IndonesianTokenizer.java
- IrishTokenizer.java
- ItalianTokenizer.java
- JapaneseTokenizer.java
- KoreanTokenizer.java
- LatvianTokenizer.java
- MalayalamTokenizer.java
- NorthernSamiTokenizer.java
- NorwegianTokenizer.java
- PolishTokenizer.java
- PortugueseTokenizer.java
- RomanianTokenizer.java
- RussianTokenizer.java
- SlovakTokenizer.java
- SloveneTokenizer.java
- SpanishTokenizer.java
- SwedishTokenizer.java
- TagalogTokenizer.java
- TamilTokenizer.java
- ThaiTokenizer.java
- TurkishTokenizer.java
- JFlexTokenAnnotator.java
- KuromojiTokenAnnotator.java
- BretonWordTokenizer.java
- EsperantoWordTokenizer.java
- GalicianWordTokenizer.java
- KhmerWordTokenizer.java
- LanguageToolTokenizer.java
- MalayalamWordTokenizer.java
- StringTools.java
- TagalogWordTokenizer.java
- WordTokenizer.java
- LanguageToolTokenAnnotator.java
- ArabicAnalyzer.java
- GermanAnalyzer.java
- HebrewAnalyzer.java
- HindiAnalyzer.java
- LiteStandardAnalyzer.java
- PersianAnalyzer.java
- ThaiAnalyzer.java
- LuceneTokenAnnotator.java
- OpenNLPTokenAnnotator.java
- BaseTokenizer.java
- StatisticalChineseAnnotator.java
- TokenizedString.java
- Tokenizer.java
- AlphabetNormalizer.java
- AlphabetPostprocessor.java
- Serbian.java
- Postprocessor.java
- Preprocessor.java
- ProcessingException.java
- ProcessingPipeline.java
- TextProcessingModels.java
- TextProcessor.java
- VoidProcessingPipeline.java
- WordTextGuessingProcessor.java
- CatalanSpaceAnnotator.pyflex
- CJKJoinerAnnotator.pyflex
- EnglishSpaceAnnotator.pyflex
- FrenchSpaceAnnotator.pyflex
- GermanSpaceAnnotator.pyflex
- ItalianSpaceAnnotator.pyflex
- StandardSpaceAnnotator.pyflex
- ThaiSpaceAnnotator.pyflex
- english.txt
- french.txt
- italian.txt
- macros.pyx
- stddetok-defs.pyx
- stddetok-rules.pyx
- CatalanTokenAnnotator.pyflex
- CommonTermsTokenAnnotator.pyflex
- EnglishTokenAnnotator.pyflex
- FrenchTokenAnnotator.pyflex
- ItalianTokenAnnotator.pyflex
- CN.voc
- TW.voc
- en.txt
- fr.txt
- it.txt
- nl.txt
- STCharacters.txt
- TSCharacters.txt
- ca.txt
- cs.txt
- de.txt
- el.txt
- en.txt
- es.txt
- fi.txt
- fr.txt
- ga.txt
- hu.txt
- is.txt
- it.txt
- lv.txt
- nl.txt
- pl.txt
- pt.txt
- ro.txt
- ru.txt
- sk.txt
- sl.txt
- sv.txt
- ta.txt
- chinese-words.list
- pipeline-schema.xsd
- postprocessor-default.xml
- preprocessor-default.xml
- NumericWordTest.java
- Assertions.java
- XMLTagProjectorSpacingTest.java
- XMLTagProjectorTest.java
- PostprocessorTest.java
- PreprocessorTest.java
- PreprocessSpecialEntitiesTest.java
- SentenceSplitTest.java
- pom.xml
- .gitignore
- pom.xml
- Memory.en__de.cfc
- Memory.en__es.cfc
- Memory.en__fr.cfc
- Memory.en__it.cfc
- Memory.en__zh.cfc
- Memory-A.cfc
- Memory-B.cfc
- Memory-C.cfc
- .gitignore
- multilingual_echo_engine.tar.gz
- stub_en_it_engine.tar.gz
- __init__.py
- connectors.py
- __init__.py
- backup.py
- onlinelearning.py
- privacy.py
- running.py
- tagprojection.py
- __main__.py
- README.md
- da-token.bin
- se-token.bin
- .gitignore
- INSTALL.md
- LICENSE
- mmt
- README.md
- requirements.txt
- requirements_cuda-11.txt
- setup.py
# Installation Guide
git clone https://github.com/modernmt/modernmt
Downloads the entire project code from GitHub to your computer.
cd modernmt
Moves into the project folder you just downloaded.
2. Docker
Easy Recommended- Git Needed to download the project code from GitHub.
- Docker Desktop Needed to build and run containers. Install it and keep it running in the background.
docker build -f docker/Dockerfile -t modernmt .
Builds a runnable image based on the Dockerfile.
docker run -p 8080:80 modernmt
Runs the built image as an actual container.
3. CMake
Mediumcd src/aligner-fastalign/src/native
This project's files live in a subfolder, so move into it first.
mkdir build && cd build
Creates a folder to hold the build output and moves into it.
cmake ..
Analyzes the source code and generates build configuration files (must be run inside the build folder).
make
Compiles the code based on the generated build configuration to produce an executable.
4. Maven (Java)
Medium- Git Needed to download the project code from GitHub.
- JDK (Java) Required to build and run Java projects.
- Maven The build tool used for the mvn command.
cd src/aligner-fastalign
This project's files live in a subfolder, so move into it first.
mvn clean install
Installs dependencies and builds the project using Maven.
5. Python
Easypip install -r requirements.txt
Installs the Python libraries listed in requirements.txt (or similar).
python <์คํํ ํ์ผ๋ช
>.py # README์์ ์ ํํ ์คํ ํ์ผ๋ช
์ ํ์ธํ์ธ์
Runs the Python script (or module).
