TikTok-Creative-Centre-Scraper

KO | EN

gitlite — search

#javascript #python #hacktoberfest #react #ai #typescript #llm #go #golang #android #machine-learning #rust #deep-learning #linux

TikTok-Creative-Centre-Scraper

(★ 4)

Scripts to scrape ads and keyword insights from TikTok Creative Centre

TikTok-Creative-Centre-Scraper 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# TODO
## Accessing the Data
~~- add in custom session ID to the cookie header (each one expires in 10 days I think?)~~
    ~~- is the cookie header going to be a problem, and is there a way to bypass it? Maybe see if an incognito browser can send ~~~~a request without the cookie/session ID?~~
    ~~- is logging in actually necessary, or can you make the request anonymously and increase the limit parameter and get the ~~~~same result? Does this resolve the cookie thing above?~~
### Headers
~~- does timestamp header need to be correct for the request to work? Will this get me banned?~~
- user sign header changes with each request. Will this cause a problem? -> Find the JS code that generates this token by checking the Initiator tab and following the trace to find the code that generates it
- some requests include the cache-control header
- Hypothesis:
    For a given search, there are a series of requests needed to get all the data, with the page number being different. The limit parameter is 3 for the first request and 20 for all subsequent requests. 
    The first request has an additional header than subsequent requests. Can I simply omit this header after making the request?
- Do we need search-id in the querystring for searching for keywords?

## UX
- build functionality for selecting industries
- Scrape data from the analysis page for each ad (API endpoint response includes total number of ads found from the given search query)
- Clean the DataFrame obtained from JSON data

TikTok-Creative-Centre-Scraper

TikTok-Creative-Centre-Scraper 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

TikTok-Creative-Centre-Scraper

TikTok-Creative-Centre-Scraper 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README