-
Notifications
You must be signed in to change notification settings - Fork 0
Home
Oliver Grund edited this page May 4, 2026
·
3 revisions
Multi-service platform for crawling, analyzing, and visualizing Instagram social networks. Maps connections around seed profiles, classifies demographics, encodes content with CLIP, and detects community structure.
Distributed as a single installable Python package (socialcloud). All subservices live under src/socialcloud/.
| Service | Port | Description |
|---|---|---|
| profile_downloader | 8001 | Instagram data proxy (RapidAPI + easycomment fallback) |
| gender_detection | 8000 | CLIP-based gender classification (GPU) |
| crawler | CLI | Smart network crawler with priority scoring |
| analysis | CLI/8002 | Embeddings, communities, visualization, photo matching |
| chrome | 9222 | Headless Chrome for scraping |
pip install -e .Provides two console scripts: crawler and analyze.
# Start services
uvicorn socialcloud.profile_downloader.main:app --port 8001
uvicorn socialcloud.gender_detection.main:app --port 8000
# Crawl a network
crawler seed <username> --budget 200
# Analyze
analyze encode
analyze communities
python -m socialcloud.analysis.visualizeSQLite at data/network.db with tables: profiles, follows, comments, posts, embeddings.