{"id":26183369,"url":"https://github.com/ejfox/paramilitary-leaks-frontend","last_synced_at":"2026-03-13T22:32:59.444Z","repository":{"id":281555234,"uuid":"945627795","full_name":"ejfox/paramilitary-leaks-frontend","owner":"ejfox","description":null,"archived":false,"fork":false,"pushed_at":"2025-04-06T15:19:39.000Z","size":17181,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-12-26T10:49:09.862Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Vue","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/ejfox.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-03-09T21:12:04.000Z","updated_at":"2025-04-17T19:50:32.000Z","dependencies_parsed_at":null,"dependency_job_id":"af21eda8-7619-4ca1-a853-79356cf0a2c1","html_url":"https://github.com/ejfox/paramilitary-leaks-frontend","commit_stats":null,"previous_names":["ejfox/paramilitary-leaks-frontend"],"tags_count":1,"template":false,"template_full_name":null,"purl":"pkg:github/ejfox/paramilitary-leaks-frontend","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ejfox%2Fparamilitary-leaks-frontend","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ejfox%2Fparamilitary-leaks-frontend/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ejfox%2Fparamilitary-leaks-frontend/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ejfox%2Fparamilitary-leaks-frontend/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/ejfox","download_url":"https://codeload.github.com/ejfox/paramilitary-leaks-frontend/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/ejfox%2Fparamilitary-leaks-frontend/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30478149,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-13T20:45:58.186Z","status":"ssl_error","status_checked_at":"2026-03-13T20:45:20.133Z","response_time":60,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-03-11T22:39:02.100Z","updated_at":"2026-03-13T22:32:59.436Z","avatar_url":"https://github.com/ejfox.png","language":"Vue","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Paramilitary Leaks Frontend\n\nA visualization dashboard for leaked paramilitary communications.\n\n## Setup\n\n```bash\n# Install dependencies\nyarn install\n\n# Start development server\nyarn dev\n```\n\n## Deployment with Netlify and Cloudflare R2\n\nThis application is configured to work with Netlify for deployment and Cloudflare R2 for storing and serving the parquet data files.\n\n### R2 Configuration\n\nThe application is configured to use the following R2 URL for the parquet file:\n```\nhttps://r2.ejfox.com/para-leaks/telegram_chats.r4.parquet\n```\n\n### Setting up Netlify\n\n1. Create a new site in Netlify:\n   - Connect to your GitHub repository\n   - Use the build settings from the `netlify.toml` file\n\n2. Configure environment variables in Netlify:\n   - Go to Site settings \u003e Environment variables\n   - Add the following variable:\n     - `R2_PARQUET_URL`: `https://r2.ejfox.com/para-leaks/telegram_chats.r4.parquet`\n\n3. Deploy your site:\n   - Trigger a new deployment\n   - The application will fetch the parquet file from R2\n\n### Local Development with R2\n\nTo test with R2 locally:\n\n1. Create a `.env` file in the root of your project\n2. The file should contain:\n   ```\n   R2_PARQUET_URL=https://r2.ejfox.com/para-leaks/telegram_chats.r4.parquet\n   ```\n3. Run the development server:\n   ```bash\n   yarn dev\n   ```\n\n### Troubleshooting R2 Issues\n\nIf you encounter the \"No magic bytes found at end of file\" error:\n\n1. Check that the parquet file is accessible at the URL\n2. Check the browser console for more detailed error messages\n\n## Data Preparation\n\nGetting data from sqlite to a csv:\n```bash\nsqlite3 -header -csv telegram_chats.db 'select * from messages;' \u003e telegram_chats.csv\n```\n\nGetting data from .csv to parquet: \n```bash\nduckdb -c \"COPY (SELECT * FROM read_csv('telegram_chats.csv')) TO 'telegram_chats.parquet' (FORMAT PARQUET);\"\n```\n\n## Data Conversion\n\nYou can create a Python script to convert the SQLite database to Parquet format:\n\n```bash\n# Install DuckDB Python package\npip install duckdb\n\n# Run the conversion script\npython3 convert_db.py\n```\n\nThe script:\n1. Opens the SQLite database using DuckDB's SQLite extension\n2. Joins the messages table with the group_chats table\n3. Maps the fields to our expected format\n4. Writes the result to a Parquet file\n\n## Features\n\n- Interactive time-based visualization of messages\n- Metadata view with statistics\n- Message feed with filtering options\n- Responsive design\n- Color coding by chat or sender\n- Tooltip displaying message details on hover\n- Time annotations on the X-axis\n- Legend showing chat groups\n\n## Technologies\n\n- Vue.js 3 with Composition API\n- Nuxt 3\n- DuckDB-wasm for parquet file processing\n- D3.js for data visualization\n- Tailwind CSS for styling\n- Cloudflare R2 for data storage\n- Netlify for deployment\n- WebGL for 2D visualization\n\n## Production\n\nBuild the application for production:\n\n```bash\n# yarn\nyarn build\n```\n\nLocally preview production build:\n\n```bash\n# yarn\nyarn preview\n```\n\n## License\n\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fejfox%2Fparamilitary-leaks-frontend","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fejfox%2Fparamilitary-leaks-frontend","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fejfox%2Fparamilitary-leaks-frontend/lists"}