reddit-detective

KO | EN

gitlite — search

#javascript #python #react #deep-learning #macos #java #nodejs #windows #cli #kubernetes #awesome-list #vue #pytorch #open-source

reddit-detective

(★ 224)

Play detective on Reddit: Discover political disinformation campaigns, secret influencers and more

File Explorer

Download Latest Version (.zip)

- - metrics.md
- - network_img.PNG
- contributing.md
- data_models.md
- index.md
- network.md
- relationships.md
- - __init__.py
  - metrics.py
  - utils.py
- __init__.py
- data_models.py
- exceptions.py
- karma.py
- network.py
- relationships.py
- utils.py
- __init__.py
- test_constraint_creation.py
- test_data_models.py
- test_karma.py
- test_metrics.py
- test_network.py
- test_relationships.py
.gitignore
.readthedocs.yml
.sonarcloud.properties
CONTRIBUTING.md
LICENSE
mkdocs.yml
README.md
requirements.txt
setup.cfg
setup.py

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# reddit-detective: Play detective on Reddit
![Python version](https://img.shields.io/badge/python-v3.7-blue)
![Neo4j version](https://badgen.net/badge/neo4j/v4.1.0/cyan)
![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)
![GitHub license](https://img.shields.io/github/license/Naereen/StrapDown.js.svg)
[![Documentation Status](https://readthedocs.org/projects/reddit-detective/badge/?version=latest)](https://reddit-detective.readthedocs.io/en/latest/?badge=latest)

[![Quality Gate Status](https://sonarcloud.io/api/project_badges/measure?project=umitkaanusta_reddit-detective&metric=alert_status)](https://sonarcloud.io/dashboard?id=umitkaanusta_reddit-detective)
[![Maintainability Rating](https://sonarcloud.io/api/project_badges/measure?project=umitkaanusta_reddit-detective&metric=sqale_rating)](https://sonarcloud.io/dashboard?id=umitkaanusta_reddit-detective)
[![Reliability Rating](https://sonarcloud.io/api/project_badges/measure?project=umitkaanusta_reddit-detective&metric=reliability_rating)](https://sonarcloud.io/dashboard?id=umitkaanusta_reddit-detective)
[![Technical Debt](https://sonarcloud.io/api/project_badges/measure?project=umitkaanusta_reddit-detective&metric=sqale_index)](https://sonarcloud.io/dashboard?id=umitkaanusta_reddit-detective)

```
pip install reddit_detective
```

**reddit-detective** represents reddit in a graph structure using Neo4j.

Created to help researchers, developers and people who are curious about
how Redditors behave.

## Helping you to:
- Detect political disinformation campaigns
- Find trolls manipulating the discussion
- Find secret influencers and idea spreaders (it might be you!)
- Detect "cyborg-like" activities
    - "What's that?" Check `reddit_detective/analytics/metrics.py` for detailed information

## Installation and Usage
- Install Neo4j 4.1.0 [here](https://neo4j.com/docs/operations-manual/current/installation/)
- Neo4j uses Cypher language as its query language. 
Knowing Cypher dramatically increases what you can do with reddit-detective 
[Click here to learn Cypher](https://neo4j.com/graphacademy/online-training/introduction-to-neo4j-40/)
- Install reddit-detective with `pip install reddit_detective`
    - **Note:** Version 0.1.2 is broken, any other version is fine

## Code Samples

### Creating a Reddit network graph
**Note:** Due to limitations of the Reddit API, Each API call may have some delay, so using reddit-detective to collect large data might be unscalable for now. **Functionality to convert tabular Reddit data to network graph will be added.**
```python
import praw
from neo4j import GraphDatabase

from reddit_detective import RedditNetwork, Comments
from reddit_detective.data_models import Redditor

# Create PRAW client instance
api = praw.Reddit(
    client_id="yourclientid",
    client_secret="yourclientsecret",
    user_agent="reddit-detective"
)

# Create driver instance
driver = GraphDatabase.driver(
    "url_of_database",
    auth=("your_username", "your_password")
)

# Create network graph
net = RedditNetwork(
        driver=driver,
        components=[
            # Other relationship types are Submissions and CommentsReplies
            # Other data models available as components are Subreddit and Submission
            Comments(Redditor(api, "BloodMooseSquirrel", limit=5)),
            Comments(Redditor(api, "Anub_Rekhan", limit=5))
        ]
    )
net.create_constraints() # Optional, doing once is enough
net.run_cypher_code()
net.add_karma(api)  # Shows karma as a property of nodes, optional
```
**Output (in Neo4j):**
![Result](https://raw.githubusercontent.com/umitkaanusta/reddit-detective/main/docs/images/network_img.PNG)

### Finding interaction score
```python
# Assuming a network graph is created and database is started

# Interaction score = A / (A + B)
# Where A is the number of comments received in user's submissions
# And B is the number of comments made by the user
from reddit_detective.analytics import metrics

score = metrics.interaction_score(driver, "Anub_Rekhan")
score_norm = metrics.interaction_score_normalized(driver, "Anub_Rekhan")
print("Interaction score for Anub_Rekhan:", score)
print("Normalized interaction score for Anub_Rekhan:", score_norm)
```
**Output:**
```
Interaction score for Anub_Rekhan: 0.375
Normalized interaction score for Anub_Rekhan: 0.057324840764331204
```

### Finding cyborg score
```python
# Assuming a network graph is created and database is started

# For a user, submission or subreddit, return the ratio of cyborg-like comments to all comments
# A cyborg-like comment is basically a comment posted within 6 seconds of the submission's creation
# Why 6? Can't the user be a fast typer? 
#   See reddit_detective/analytics/metrics.py for detailed information

from reddit_detective.analytics import metrics

score, comms = metrics.cyborg_score_user(driver, "Anub_Rekhan")
print("Cyborg score for Anub_Rekhan:", score)
print("List of Cyborg-like comments of Anub_Rekhan:", comms)
```
**Output:**
```
Cyborg score for Anub_Rekhan: 0.2
List of Cyborg-like comments of Anub_Rekhan: ['q3qm5mo']
```

### Running a Cypher statement
```python
# Assuming a network graph is created and database is started

session = driver.session()
result = session.run("Some cypher code")
session.close()
```

## Upcoming features
- [ ] Convert any tabular Reddit data to Neo4j Graph with given instructions from the user
- [ ] UserToUser relationships
    - A relationship to link users with its only property being the amount of **encounters**
    - Having ties with the same submission is defined as an **encounter**
- [ ] Add more paper-inspired metrics
- [ ] Create a wrapper for centrality metrics of Neo4j GDSC (Graph data science library)

## Inspiration
List of works/papers that inspired reddit-detective:
```
authors: [Sachin Thukral (TCS Research), Hardik Meisheri (TCS Research),
Arnab Chatterjee (TCS Research), Tushar Kataria (TCS Research),
Aman Agarwal (TCS Research), Lipika Dey (TCS Research),
Ishan Verma (TCS Research)]

title: Analyzing behavioral trends in community driven
discussion platforms like Reddit

published_in: 2018 IEEE/ACM International Conference on Advances in 
Social Networks Analysis and Mining (ASONAM)

DOI: 10.1109/ASONAM.2018.8508687
```

reddit-detective

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

reddit-detective

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

Download README