{"id":13442002,"url":"https://github.com/facebookarchive/scribe","last_synced_at":"2025-12-17T21:10:56.487Z","repository":{"id":536508,"uuid":"165886","full_name":"facebookarchive/scribe","owner":"facebookarchive","description":"Scribe is a server for aggregating log data streamed in real time from a large number of servers.","archived":true,"fork":false,"pushed_at":"2020-08-27T18:55:14.000Z","size":2265,"stargazers_count":3923,"open_issues_count":51,"forks_count":793,"subscribers_count":307,"default_branch":"master","last_synced_at":"2024-09-27T03:42:47.689Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"C++","has_issues":false,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/facebookarchive.png","metadata":{"files":{"readme":"README","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2009-04-02T04:55:56.000Z","updated_at":"2024-09-22T15:14:09.000Z","dependencies_parsed_at":"2022-06-21T15:04:49.858Z","dependency_job_id":null,"html_url":"https://github.com/facebookarchive/scribe","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/facebookarchive%2Fscribe","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/facebookarchive%2Fscribe/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/facebookarchive%2Fscribe/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/facebookarchive%2Fscribe/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/facebookarchive","download_url":"https://codeload.github.com/facebookarchive/scribe/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":234575211,"owners_count":18854924,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T03:01:40.533Z","updated_at":"2025-09-28T23:31:49.537Z","avatar_url":"https://github.com/facebookarchive.png","language":"C++","readme":"Archived Repo\n=============\n\nThis is an archived project and is no longer supported or updated by Facebook. \nPlease do not file issues or pull-requests against this repo. If you wish to \ncontinue to develop this code yourself, we recommend you fork it.\n\n-------------\n\nIntroduction\n============\n\nScribe is a server for aggregating log data that's streamed in real\ntime from clients. It is designed to be scalable and reliable.\n\nSee the Scribe Wiki for documentation:\nhttp://wiki.github.com/facebook/scribe\n\nKeep up to date on Scribe development by joining the Scribe Discussion Group:\nhttp://groups.google.com/group/scribe-server/\n\n\nLicense (See LICENSE file for full license)\n===========================================\nCopyright 2007-2008 Facebook\n\nLicensed under the Apache License, Version 2.0 (the \"License\");\nyou may not use this file except in compliance with the License.\nYou may obtain a copy of the License at\n\n    http://www.apache.org/licenses/LICENSE-2.0\n\nUnless required by applicable law or agreed to in writing, software\ndistributed under the License is distributed on an \"AS IS\" BASIS,\nWITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\nSee the License for the specific language governing permissions and\nlimitations under the License.\n\n\nHierarchy\n=========\n\nscribe/\n\n  aclocal/\n    Contains scripts for building/linking with Boost\n\n  examples/\n    Contains simple examples of using Scribe\n\n  if/\n    Contains Thrift interface for Scribe\n\n  lib/\n    Contains Python package for Scribe\n\n  src/\n    Contains Scribe source\n\n  test/\n    Contain php scripts for testing scribe\n\n\nRequirements\n============\n\n[libevent] Event Notification library\n[boost] Boost C++ library (version 1.36 or later)\n[thrift] Thrift framework (version 0.5.0 or later)\n[fb303] Facebook Bassline (included in thrift/contrib/fb303/)\n   fb303 r697294 or later is required.\n[hadoop] optional. version 0.19.1 or higher (http://hadoop.apache.org)\n\nThese libraries are open source and may be freely obtained, but they are not\nprovided as a part of this distribution.\n\n\nHelpful tips:\n-Thrift, fb303, and scribe installation expects python to be installed\n under /usr.  See PY_PREFIX option in 'configure --help' to change this path.\n-Some python installs do not include python site-packages in the default\n python include path.  If python cannot find the installed packages for\n scribe or fb303, try setting the environment variable PYTHONPATH to the\n location of the installed packages.  This path gets output during\n 'make install'. (Eg: PYTHONPATH='/usr/lib/python2.5/site-packages').\n\n\nTo build\n========\n\n./bootstrap.sh \u003cconfigure options\u003e\nmake\n\n(If you have multiple versions of Boost installed, see Boost configure options below.)\n\nSubsequent builds\n=================\n\n./bootstrap \u003cconfigure options\u003e\nmake\n\nOR\n\n./configure \u003cconfigure options\u003e\nmake\n\nNOTE: After the first run with bootstrap.sh you can use \"[ ./bootstrap | ./configure ] \u003coptions\u003e\" followed by \"make\"\nto create builds with different configurations. \"bootstrap\" can be passed the same arguments as \"configure\".\n\nMake sure that if you change configure.ac and|or add macros run \"bootstrap.sh\".\nto regenerate configure. In short whenever in doubt run \"bootstrap.sh\".\n\n\nConfigure options\n=================\n\nTo find all available configure options run\n./configure --help\n\nUse *only* the listed options.\n\nExamples:\n# To disable optimized builds and turn on debug. [ default has been set to optimized]\n./configure --disable-opt\n\n# To disable static libraries and enable shared libraries. [ default has been set to static]\n./configure --disable-static\n\n# To build scribe with Hadoop support\n./configure --enable-hdfs\n\n# If the build process cannot find your Hadoop/Jvm installs, you may need to specify them manually:\n./configure --with-hadooppath=/usr/local/hadoop --enable-hdfs CPPFLAGS=\"-I/usr/local/java/include -I/usr/local/java/include/linux\" LDFLAGS=\"-ljvm -lhdfs\"\n\n# To set thrift home to a non-default location\n./configure --with-thriftpath=/myhome/local/thrift\n\n# If Boost is installed in a non-default location or there are multiple Boost versions\n# installed, you will need to specify the Boost path and library names\n./configure --with-boost=/usr/local --with-boost-system=boost_system-gcc40-mt-1_36 --with-boost-filesystem=boost_filesystem-gcc40-mt-1_36\n\n\nInstall\n=======\n\nas root:\nmake install\n\n\nRun\n===\n\nSee the examples directory to learn how to use Scribe.\n\n\nAcknowledgements\n================\nThe build process for Scribe uses autoconf macros to compile/link with Boost.\nThese macros were written by Thomas Porschberg, Michael Tindal, and\nDaniel Casimiro.  See the m4 files in the aclocal subdirectory for more\ninformation.\n","funding_links":[],"categories":["C++","Data Ingestion"],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffacebookarchive%2Fscribe","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffacebookarchive%2Fscribe","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffacebookarchive%2Fscribe/lists"}