open-source-research-notebooks

KO | EN

gitlite — search

#javascript #hacktoberfest #react #typescript #llm #deep-learning #docker #nodejs #awesome #kubernetes #awesome-list #pytorch #mcp #ios

open-source-research-notebooks

(★ 322)

Jupyter notebooks helping open source researchers, journalists, and fact-checkers use command line tools and code projects for digital investigations.

File Explorer

Download Latest Version (.zip)

- - .gitignore
  - civharm.csv
  - geoclustering.ipynb
  - search-grid-generator.ipynb
  - shadow-chronolocator.ipynb
  - telegram-phone-number-checker.ipynb
  - vk-url-scraper.ipynb
  - wayback-google-analytics.ipynb
- - .gitignore
  - deepface.ipynb
  - exiftool.ipynb
  - holehe.ipynb
  - maigret.ipynb
  - wayback-machine-downloader.ipynb
  - whisper.ipynb
  - yt_dlp.ipynb
- - intro-to-notebooks.ipynb
.gitignore
LICENSE
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Open Source Research Notebooks

A collection of Jupyter Notebooks that can be to learn or run open source investigations. We cover command line tools, scripts, and methods. We aim to help open source researchers, journalists, and fact-checkers use command line tools and code projects for digital investigations.

<blockquote align="center">
  
  📰 Read <a href="https://www.bellingcat.com/resources/2024/03/06/how-code-notebooks-enable-open-source-research/">our guide to code notebooks here.</a>

📹 Watch our tutorial on Youtube:
  
[![YouTube](http://i.ytimg.com/vi/ymCMy8OffHM/mqdefault.jpg)](https://www.youtube.com/watch?v=ymCMy8OffHM)
  
  </blockquote>

### Is this for me?
If you've used Jupyter notebooks before you should be good to navigate this right away.

If Jupyter Notebooks/Google Colaboratory don't ring any bells, you should know they are one of the easiest ways to interact with code and the command line, in essence they look like an interactive website where you execute one cell at a time to run different pieces of code, you can also edit the code and adapt it to your needs.

There's plenty of good tutorials about Jupyter Notebooks and the environments you can run them in (like [Google Colab](https://www.youtube.com/watch?v=inN8seMm7UI) or Binder.org), we do advise you to spend 5min doing that. Additionally, we created a simple notebook that you can [view (static)](notebooks/methods/intro-to-notebooks.ipynb), [run on Google Colab](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/methods/intro-to-notebooks.ipynb), [run on Binder]([TODO](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fmethods%2Fintro-to-notebooks.ipynb)), or [run on Kaggle](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/methods/intro-to-notebooks.ipynb) that shows the core skills needed to understand what this is all about!

### Why Notebooks?
Jupyter Notebooks
- make it easier to install and run software (less "this does not work on my machine" errors)
- make it safer to run unknown code, when you run it on a Notebook service like [Google Colaboratory](https://colab.google/), [Binder](https://mybinder.org/), or [Kaggle Notebooks](https://www.kaggle.com/docs/notebooks)
- make it simpler to document specific code uses: they combine styled documentation with code
- are quick to make and easy to use after you understand how to click through the code cells and edit any custom input
- can run bash commands (command line) as well as code (Python and more)

# Available Notebooks
The top part of the table consists of tools and methods developed at Bellingcat; the bottom part of community developed tools and methods.
|           **Notebook**            | **Level**               | **Description**                                                                                           | **Notebook links**                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | **Tags**                               |
| :-------------------------------: | ----------------------- | --------------------------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | -------------------------------------- |
| **Telegram Phone Number Checker** | ![easy][easy-badge]     | Check if phone numbers have associated Telegram accounts                                                  | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/telegram-phone-number-checker.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fbellingcat%2Ftelegram-phone-number-checker.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/telegram-phone-number-checker.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/bellingcat/telegram-phone-number-checker.ipynb) | `scraping`, `social-media`, `telegram` |
|   **Wayback Google Analytics**    | ![easy][easy-badge]     | Uncover historical analytics ids via the Wayback Machine                                                  | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/wayback-google-analytics.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fbellingcat%2Fwayback-google-analytics.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/wayback-google-analytics.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/bellingcat/wayback-google-analytics.ipynb)                     | `wayback-machine`, `google-analytics`  |
|         **Geoclustering**         | ![medium][medium-badge] | Find clusters of incidents from a CSV of incidents                                                        | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/geoclustering.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fbellingcat%2Fgeoclustering.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/geoclustering.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/bellingcat/geoclustering.ipynb)                                                                 | `ai`, `clustering`, `gis`              |
|        **vk-url-scraper**         | ![medium][medium-badge] | Scrape data and download media from VKontakte URLs                                                        | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/vk-url-scraper.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fbellingcat%2Fvk-url-scraper.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/vk-url-scraper.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/bellingcat/vk-url-scraper.ipynb)                                                             | `scraping`, `social-media`             |
|        **Search Grid Generator**         | ![medium][easy-badge] | Generate grid in KML file for systematic area searches.                                              | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/search-grid-generator.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fbellingcat%2Fsearch-grid-generator.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/search-grid-generator.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/bellingcat/search-grid-generator.ipynb)                                                             | `geolocation`, `maps`             |
|        **Shadow Chronolocator**         | ![easy][easy-badge] | Chronolocate shadows when the location is known.                                              | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/shadow-chronolocator.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fbellingcat%2Fshadow-chronolocator.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/bellingcat/shadow-chronolocator.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/bellingcat/shadow-chronolocator.ipynb)                                                             | `geolocation`, `maps`             |
|                 -                 | -                       | -                                                                                                         | -                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                  | -                                      |
|        **OpenAI Whisper**         | ![easy][easy-badge]     | AI audio/video transcription and translation                                                              | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/whisper.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fcommunity%2Fwhisper.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/whisper.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/community/whisper.ipynb)                                                                                             | `ai`, `speech-recognition`             |
|            **Holehe**             | ![easy][easy-badge]     | Find accounts associated with an email                                                                    | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/holehe.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fcommunity%2Fholehe.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/holehe.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/community/holehe.ipynb)                                                                                                 | `digital-footprint-tracing`            |
|            **Maigret**            | ![easy][easy-badge]     | Find accounts associated with a username                                                                  | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/maigret.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fcommunity%2Fmaigret.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/maigret.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/community/maigret.ipynb)                                                                                             | `digital-footprint-tracing`            |
|  **Wayback Machine Downloader**   | ![easy][easy-badge]     | Download an entire website from the Wayback Machine.                                                      | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/wayback-machine-downloader.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fcommunity%2Fwayback-machine-downloader.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/wayback-machine-downloader.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/community/wayback-machine-downloader.ipynb)                 | `wayback-machine`                      |
|            **YT-DLP**             | ![easy][easy-badge]     | Download and manipulate videos from hundreds of online platforms. Includes advanced commands with Python. | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/yt_dlp.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fcommunity%2Fyt_dlp.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/yt_dlp.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/community/yt_dlp.ipynb)                                                                                                 | `archiving`, `media-downloads`         |
|           **ExifTool**            | ![medium][medium-badge] | Extract and analyse file metadata tags                                                                    | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/exiftool.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fcommunity%2Fexiftool.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/exiftool.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/community/exiftool.ipynb)                                                                                         | `digital-forensics`, `metadata`        |
|           **Deepface**            | ![medium][medium-badge] | AI face comparison and analysis                                                                           | [![Colab][colab-badge]](https://colab.research.google.com/github/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/deepface.ipynb) [![Binder][binder-badge]](https://mybinder.org/v2/gh/bellingcat/open-source-research-notebooks/main?labpath=notebooks%2Fcommunity%2Fdeepface.ipynb) [![Kaggle Notebook][kaggle-badge]](https://kaggle.com/kernels/welcome?src=https://github.com/bellingcat/open-source-research-notebooks/blob/main/notebooks/community/deepface.ipynb) [![Jupyter Notebook][jupyter-badge]](https://raw.githubusercontent.com/bellingcat/open-source-research-notebooks/main/notebooks/community/deepface.ipynb)                                                                                         | `ai`, `image-analysis`                 |

- ![easy][easy-badge] Entry level notebooks, you need only know how to run cells and edit specific values
- ![medium][medium-badge] Notebooks that require higher technical know-how, or previous setups
- ![advanced][advanced-badge] Notebooks that require technical understanding or adapting code

[colab-badge]: https://colab.research.google.com/assets/colab-badge.svg
[binder-badge]: https://mybinder.org/badge_logo.svg
[kaggle-badge]: https://kaggle.com/static/images/open-in-kaggle.svg
[jupyter-badge]: https://img.shields.io/badge/jupyter-.ipynb%20file-orange
[easy-badge]: https://img.shields.io/badge/easy-%234CAF50?style=for-the-badge
[medium-badge]: https://img.shields.io/badge/medium-%23FF9800?style=for-the-badge
[advanced-badge]: https://img.shields.io/badge/advanced-%23F44336?style=for-the-badge

open-source-research-notebooks

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

open-source-research-notebooks

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

Download README