maxent_toolbox

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

★ 15 Open GitHub ↗

Maximum Entropy toolbox for MATLAB

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<h2>maxent_toolbox</h2>

Maximum entropy toolbox for MATLAB is a free, open-source toolbox for finding the maximum entropy distribution of training data, based on a set of constraints or observables over the data.

Maximum entropy models give the mathematically minimal probabilistic models of the states or configurations of a systems, given the mean values of some set of observed functions. Since the entropy of a distribution measures the randomness or lack of interaction among different variables, the minimally structured distribution given a set of observables is the distribution with the maximal entropy that is consistent with these observables. These models are used approximate probability distributions of discrete states from limited data, where standard approaches (such as counting the states) cannot be applied.

This toolbox is intended for learning probability distributions of binary activity patterns, i.e. patterns in the form
1000110100. Examples of problems where one might want to learn such distributions are characterising the joint
activity of neural populations (0/1 denoting if a certain neuron fired within a small time window) or gene expression profiles
(0/1 denoting if a certain gene is being expressed). The toolbox takes as an input a set of samples of activity patterns and learns a model of the probability over all states, thus extrapolating to the entire distribution over all possible activity patterns.

Mathematically, in its discrete form, if xi
 are the elements of the system (here variables taking discrete values), then the maximum entropy model for p(x1,x2…xn)
 which is consistent with the average values of a set of functions f1(x)...fk(x) has a unique solution in the form:

where &#955;1...&#955;k are the model parameters (or Lagrange multipliers) which can be found numerically.

The user can choose between several variants of maximum entropy models, each relying on a different set of observables or constraints. The maximum entropy models currently supported by this package are
<ul>
<li>Independent model, which uses &#60;xi&#62;data as constraints</li>
<li><a href="http://www.weizmann.ac.il/neurobiology/labs/schneidman/Publications/Schneidman+al_2006-Nature.pdf">Pairwise maximum entropy model</a>: &#60;xi&#62;data and &#60;xixj&#62;data</li>
<li><a href="http://wp.ist.ac.at/group_tkacik/wp-content/uploads/2011/02/JStatMech_Simplest_Maxent.pdf">K-synchrony model</a>: &#60;&Sigma;ixi&#62;data</li>
<li><a href="http://wp.ist.ac.at/group_tkacik/wp-content/uploads/2011/02/PLOSCompBio_KPairwise.pdf">K-Pairwise model</a></li>
<li>Arbitrary set of high-order correlations</li>
<li><a href="https://www.biorxiv.org/node/143383.abstract">RP (Random Projection) model</a></li>
<li>Any combination of the above models</li>
</ul>

The toolbox automatically switches between exhaustive solutions for small (&#60;30) groups of variables and Markov Chain Monte Carlo (MCMC) methods for larger groups and can be used to learn distributions of up to several hundreds of binary variables. The software is provided as an installable toolbox for MATLAB, and most of the code is written in heavily optimized C++ precompiled for Windows (64 bit), OS X and Linux (CentOS).
<h2>Download</h2>
<ul>
<li><a href="https://github.com/orimaoz/maxent_toolbox/releases/latest">Download latest version</a> packaged as an installable MATLAB toolbox with mex files precompiled for Windows 64bit, MacOS and Linux (CentOS 64bit).</li>
<li><a href="https://github.com/orimaoz/maxent_toolbox">Download most recent source code</a>.</li>
</ul>

<h2>Install</h2>
Click on the downloaded .mltbx file to install it as a toolbox for MATLAB. To uninstall, open MATLAB and navigate to Add-Ons -> Manage Add-Ons.
 
<h2><a id="documentation" class="anchor" href="#documentation-list" aria-hidden="true"></a>Documentation</h2>
If this is the first time you are using the toolbox, start by reading the <a href="quickstart.html">quick start guide</a> or take a look at some <a href="maxent_example.html">example code</a> (which you can also run by typing "maxent_example" after installing the toolbox).
Experienced users can refer to the <a href="function_reference.html">function reference</a> for details about each of the available functions in the toolbox.
You can also check out answers to some<a href="faq.html"> frequently asked questions</a>.

<h2><a id="build" class="anchor" href="#build" aria-hidden="true"></a>Build</h2>
<a href="build.html">Build instructions</a> for Windows, MacOS and Unix. Note that the toolbox installer already contains precompiled binaries, so building the toolbox is only necessary if you use a nonstandard operating system or want to make changes in the code.

<h2>Cite</h2>
If you use this toolbox as part of a published academic work, please cite it as:
<pre>
Ori Maoz and Elad Schneidman. maxent_toolbox: Maximum Entropy Toolbox for MATLAB, version 1.0.2. 2017. doi: 10.5281/zenodo.191625. URL https://orimaoz.github.io/maxent_toolbox.
</pre>
The corresponding BibTeX citation:
<pre>
@misc{Maoz2017_191625,
author = {Maoz, Ori and Schneidman, Elad},
title = {maxent{\_}toolbox: Maximum Entropy Toolbox for MATLAB, version 1.0.2},
year = {2017},
version = {1.02},
publisher = {Zenodo},
doi = {10.5281/zenodo.191625},
url = {https://orimaoz.github.io/maxent_toolbox}
}
</pre>

<h2>License</h2>
The Maximum Entropy Toolbox for MATLAB is free and open source, distributed under the <a href="https://opensource.org/licenses/MIT">MIT license</a>.

<h2>
<a id="authors-and-contributors" class="anchor" href="#authors-and-contributors" aria-hidden="true"></a>Authors and Contributors</h3>
Ori Maoz, <a href="mailto:orimaoz@gmail.com"> orimaoz@gmail.com</a>

maxent_toolbox

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README