{"id":28638900,"url":"https://github.com/future-agi/futureagi-sdk","last_synced_at":"2025-07-02T04:33:12.673Z","repository":{"id":254810161,"uuid":"837607096","full_name":"future-agi/futureagi-sdk","owner":"future-agi","description":"We help GenAI teams maintain high-accuracy for their Models in production. Purpose Built, Scalable \u0026 10X faster than traditional methods to help them Align AI models to their users .","archived":false,"fork":false,"pushed_at":"2025-05-30T14:38:42.000Z","size":18109,"stargazers_count":16,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-06-22T11:44:47.340Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"bsd-3-clause","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/future-agi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-08-03T13:22:28.000Z","updated_at":"2025-06-21T18:30:00.000Z","dependencies_parsed_at":null,"dependency_job_id":"c9733363-0bd2-4a8d-bf61-c8391500cbdc","html_url":"https://github.com/future-agi/futureagi-sdk","commit_stats":null,"previous_names":["future-agi/client","future-agi/futureagi-python"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/future-agi/futureagi-sdk","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/future-agi%2Ffutureagi-sdk","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/future-agi%2Ffutureagi-sdk/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/future-agi%2Ffutureagi-sdk/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/future-agi%2Ffutureagi-sdk/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/future-agi","download_url":"https://codeload.github.com/future-agi/futureagi-sdk/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/future-agi%2Ffutureagi-sdk/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263075320,"owners_count":23409893,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-06-12T19:09:13.787Z","updated_at":"2025-07-02T04:33:12.648Z","avatar_url":"https://github.com/future-agi.png","language":"Python","funding_links":[],"categories":["Security"],"sub_categories":["Observability"],"readme":"# Future AGI\r\n\r\n![Company Logo](https://fi-content.s3.ap-south-1.amazonaws.com/Logo.png)\r\n\r\nWelcome to Future AGI - Empowering GenAI Teams with Advanced Performance Management\r\n\r\n# Overview\r\n\r\nFuture AGI is the world's most accurate AI evaluation, observability and optimization platform. We help teams build near perfect AI applications across software and hardware through comprehensive model monitoring, testing and optimization.\r\n\r\n**Key Features**\r\n\r\n* **_World's Best Evaluations_**: Power your AGI development with industry-leading evaluation frameworks and metrics.\r\n* **_Ultra-Fast Guardrails_**: Implement real-time safety checks with sub-100ms latency for production-ready AI systems.\r\n* **_Comprehensive SDKs_**: Rapidly prototype and observe agent behavior with our developer-friendly toolkits.\r\n* **_Advanced Analytics_**: Monitor and optimize agent performance with detailed insights and actionable metrics.\r\n\r\n# Quickstart\r\n**Installation**\r\n\r\nTo install the client, you can clone the repository or install the library:\r\n\r\nInstall the library in an environment using Python \u003e= 3.6.\r\n```\r\n$ pip3 install futureagi\r\n```\r\nOr clone the repo:\r\n\r\n```\r\n$ git clone https://github.com/future-agi/client\r\n```\r\n\r\n**Initialisation**\r\n\r\nTo Start working with Future AGI, you need to create an account and get your API key and secret key.\r\nYou will be needing these keys to work with the Future AGI platform.\r\n\r\nStart working by uploading your data to the platform\r\n\r\n```\r\n# pip install futureagi\r\n\r\nimport os\r\nfrom fi.datasets import Dataset\r\nfrom fi.datasets.types import (\r\n    Cell,\r\n    Column,\r\n    DatasetConfig,\r\n    DataTypeChoices,\r\n    ModelTypes,\r\n    Row,\r\n    SourceChoices,\r\n)\r\n\r\n# Set environment variables\r\nos.environ[\"FI_API_KEY\"] = \"\u003cYour API Key\u003e\"\r\nos.environ[\"FI_SECRET_KEY\"] = \"\u003cYour Secret Key\u003e\"\r\n\r\n# Get existing dataset\r\nconfig = DatasetConfig(name=\"example_dataset\", model_type= ModelTypes.GENERATIVE_LLM)\r\ndataset = Dataset(dataset_config=config)\r\ndataset = dataset.create_dataset(dataset_config=config)\r\n\r\n# Define columns\r\ncolumns = [\r\n    Column(\r\n        name=\"user_query\",\r\n        data_type=DataTypeChoices.TEXT,\r\n        source=SourceChoices.OTHERS\r\n    ),\r\n    Column(\r\n        name=\"response_quality\",\r\n        data_type=DataTypeChoices.INTEGER,\r\n        source=SourceChoices.OTHERS\r\n    ),\r\n    Column(\r\n        name=\"is_helpful\",\r\n        data_type=DataTypeChoices.BOOLEAN,\r\n        source=SourceChoices.OTHERS\r\n    )\r\n]\r\n\r\n# Define rows\r\nrows = [\r\n    Row(\r\n        order=1,\r\n        cells=[\r\n            Cell(column_name=\"user_query\", value=\"What is machine learning?\"),\r\n            Cell(column_name=\"response_quality\", value=8),\r\n            Cell(column_name=\"is_helpful\", value=True)\r\n        ]\r\n    ),\r\n    Row(\r\n        order=2,\r\n        cells=[\r\n            Cell(column_name=\"user_query\", value=\"Explain quantum computing\"),\r\n            Cell(column_name=\"response_quality\", value=9),\r\n            Cell(column_name=\"is_helpful\", value=True)\r\n        ]\r\n    )\r\n]\r\n\r\ntry:\r\n    # Add columns and rows to dataset\r\n    dataset = dataset.add_columns(columns=columns)\r\n    dataset = dataset.add_rows(rows=rows)\r\n    print(\"✓ Data added successfully\")\r\n    \r\nexcept Exception as e:\r\n    print(f\"Failed to add data: {e}\")\r\n\r\n```\r\n\r\n**Initialises the Future AGI Dataset Client**\r\n* _fi_api_key_: provided API key associated with your account.\r\n* _fi_secret_key_: provided identifier to connect records to spaces.\r\n* _DatasetConfig_: The configuration for the dataset.\r\n* _create_dataset_: The function to create the dataset.\r\n\r\n\r\nYou can also set these keys as environment variables:\r\n```\r\nexport FI_API_KEY=your_api_key\r\nexport FI_SECRET_KEY=your_secret_key\r\n```\r\nAnd then initialise the Dataset without passing the keys directly:\r\n\r\n**_[For full details, see our docs.](https://docs.futureagi.com/)_**\r\n\r\n\r\n# FAQ’s:\r\n\r\n1. Q: How do you give a Evaluation score without human in the loop?\r\n\r\nOur secret Sauce is a Critique AI agent that can deliver powerful evaluation framework without need for human in the loop. What’s more is that it is 100% configurable as per new evolving use cases. Now anything that you can imagine your AI system should deliver - you can configure our platform to manage it.\r\n\r\n2. Q: What all inputs Future AGI platform needs?\r\n\r\nWe are a data-agnostic platform and can work with any data kind of that you have. Whether it is text, image, audio, video, or any other data type, we can help you annotate, evaluate, optimize and monitor your AI system.\r\n\r\n3. Q: I don't want to share data with Future AGI, can I still use it?\r\n\r\nYes, you can now install our SDK in your private cloud and take advantage of our strong platform to align your AI system to your users.\r\n\r\n\r\n4. Q: My app uses multiple models with multiple modalities, can you work with images and audio also?\r\n\r\nYes we can.\r\n\r\n5. Q: How much time does it take to integrate the Future AGI platform? How much bandwidth would be required?\r\n\r\nIt takes just 2 minutes to integrate a few lines of code and your data starts showing on our platform. Try it today.\r\n\r\n\r\n# Resources\r\n\r\n**Website**: https://www.futureagi.com/\r\n\r\n**Documentation**: https://docs.futureagi.com/\r\n\r\n**PyPI** : https://pypi.org/project/futureagi/\r\n\r\n# Connect with us\r\n\r\n**Email**: support@futureagi.com\r\n\r\n\r\n**LinkedIn**: https://www.linkedin.com/company/futureagi\r\n\r\n**X**: https://x.com/FutureAGI_\r\n\r\n**Reddit**: https://www.reddit.com/user/Future_AGI/submitted/\r\n\r\n**Substack**: https://substack.com/@futureagi\r\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffuture-agi%2Ffutureagi-sdk","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ffuture-agi%2Ffutureagi-sdk","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ffuture-agi%2Ffutureagi-sdk/lists"}