https://github.com/pushshift/tweet-id_components

Go program to extract tweet id components
https://github.com/pushshift/tweet-id_components

Last synced: 10 days ago
JSON representation

Go program to extract tweet id components

• Host: GitHub
• URL: https://github.com/pushshift/tweet-id_components
• Owner: pushshift
• Created: 2019-03-09T03:59:02.000Z (about 7 years ago)
• Default Branch: master
• Last Pushed: 2019-03-09T04:35:55.000Z (about 7 years ago)
• Last Synced: 2025-03-01T06:44:26.442Z (about 1 year ago)
• Language: Go
• Size: 1.04 MB
• Stars: 3
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
My first attempt at creating a Golang program to do something somewhat useful!

This will allow a bunch of tweet ids to be piped into it and it will extract the following components:

sequence_id

server_id

machine_id

datacenter_id

creation_time (milliseconds)

Example usage:

cat tweets.ndjson | jq '.id_str' | ./tweet -c all

Speed: Processes around one million ids per second (~60x faster than Python)