KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#dsh #dsh-plugin #developer-tools #ai-agent #claude-code #codex #typescript #ai-agents #mcp #cli #rust #deepseek-harness

joshua

★ 114 Open GitHub ↗

Apache Joshua

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![Build Status](https://travis-ci.org/apache/joshua.svg?branch=master)](https://travis-ci.org/apache/joshua)
[![homebrew](https://img.shields.io/homebrew/v/joshua.svg?maxAge=2592000?style=plastic)](http://braumeister.org/formula/joshua)
[![license](https://img.shields.io/github/license/apache/joshua.svg?maxAge=2592000?style=plastic)](http://www.apache.org/licenses/LICENSE-2.0)
[![Jenkins](https://img.shields.io/jenkins/s/https/builds.apache.org/joshua_master.svg?maxAge=2592000?style=plastic)](https://builds.apache.org/job/joshua_master/)
[![Maven Central](https://img.shields.io/maven-central/v/org.apache.joshua/joshua-incubating.svg)](http://search.maven.org/#search|ga|1|a%3A%22joshua-incubating%22)
[![Twitter Follow](https://img.shields.io/twitter/follow/ApacheJoshua.svg?style=social&label=Follow&maxAge=2592000?style=plastic)](https://twitter.com/ApacheJoshua)

# Welcome to Apache Joshua
<img src="https://s.apache.org/joshua_logo" align="right" width="300" />

Joshua is a statistical machine translation toolkit for both phrase-based (new in version 6.0) and syntax-based decoding. It can be run with pre-built language packs available for download, and can also be used to build models for new language pairs. Among the many features of
Joshua are:

* Support for both phrase-based and syntax-based decoding models
 * Translation of weighted input lattices
 * [Thrax](https://github.com/joshua-decoder/thrax): a Hadoop-based, scalable grammar extractor
 * A [sparse feature architecture](http://cs.jhu.edu/~post/joshua-docs/md_sparse_features.html) supporting an arbitrary number of features

The latest release of Joshua is always linked to directly from the [Home Page](http://joshua.apache.org)

## New in 6.X

Joshua 6.X includes the following new features:

* A fast phrase-based decoder with the ability to read [Moses](http://statmt.org/moses) phrase tables
 * Large speed improvements compared to the previous syntax-based decoder
 * Special input handling
 * A host of bugfixes and stability improvements

## Quick start

Joshua must be run with a Java JDK 1.8 minimum.

To run the decoder in any form requires setting a few basic environment variables: ```$JAVA_HOME```, ```$JOSHUA```, and, for certain (optional) portions of the model-training pipeline, potentially ```$MOSES```.

export JAVA_HOME=/path/to/java  # maybe /usr/java/home
    export JOSHUA=/path/to/joshua

You might also find it helpful to set these:

export LC_ALL=en_US.UTF-8
    export LANG=en_US.UTF-8

Then, compile Joshua by typing:

cd $JOSHUA
    mvn clean package

Install required (Ubuntu) packages:

sudo apt-get install cmake libbz2-dev liblzma-dev libboost-all-dev ant gcc g++

You also need to download and compile [KenLM](http://kheafield.com/code/kenlm/) and [Thrax](https://github.com/joshua-decoder/thrax):

bash ./download-deps.sh

The basic method for invoking the decoder looks like this:

cat SOURCE | $JOSHUA/bin/joshua-decoder -m MEM -c CONFIG OPTIONS > OUTPUT

Some example usage scenarios and scripts can be found in the [examples/](https://github.com/apache/joshua/tree/master/examples) directory.

## Development With Eclipse

If you are hoping to work on the decoder, we suggest you use Eclipse. You can get started
with this by typing

mvn eclipse:eclipse

## Working with "language packs"

Joshua includes a number of "language packs", which are pre-built models that allow you to use the translation system as a black box, without worrying too much about how machine translation works. You can browse the models available for download on the [Joshua website](http://joshua.apache.org/language-packs/).

## Building new models

Joshua includes a pipeline script that allows you to build new models, provided you have training data.  This pipeline can be run (more or less) by invoking a single command, which handles data preparation, alignment, phrase-table or grammar construction, and tuning of the model parameters. See [the documentation](https://cwiki.apache.org/confluence/x/Dh-tAw) for a walkthrough and more information about the many available options.

# License
Joshua is licensed and released under the permissive [Apache License v2.0](http://www.apache.org/licenses/LICENSE-2.0), a copy of which ships with the Joshua source code.

joshua

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README