https://github.com/ara3d/bim-open-schema
BIM to Parquet and DuckDB
https://github.com/ara3d/bim-open-schema
aec analytics bim duckdb etl ifc parquet revit
Last synced: about 1 month ago
JSON representation
BIM to Parquet and DuckDB
- Host: GitHub
- URL: https://github.com/ara3d/bim-open-schema
- Owner: ara3d
- License: mit
- Created: 2025-07-08T13:09:15.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2025-08-12T16:01:44.000Z (about 2 months ago)
- Last Synced: 2025-08-22T06:18:15.772Z (about 1 month ago)
- Topics: aec, analytics, bim, duckdb, etl, ifc, parquet, revit
- Language: C#
- Homepage:
- Size: 98.1 MB
- Stars: 19
- Watchers: 3
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# BIM Open Schema
> _BIM Analytics via Parquet and DuckDB_
**BIM Open Schema** is an open formal specification of BIM data that is designed for modern
analytics tools and optimized for columnar data formats like [**Parquet**](https://parquet.apache.org/) and
relational databases like [**DuckDB**](https://duckdb.org/).
## 📖 Repo Contents
This repo provides:
1. Official specification [in the form of valid C# code](https://github.com/ara3d/bim-open-schema/blob/main/src/Ara3D.BimOpenSchema/BIMOpenSchema.cs).
2. [Sample test file](https://github.com/ara3d/bim-open-schema/tree/main/data/input) generated from the Snowdon sample
3. C# libraries and tests files for reading / writing BIM Open Schema data, also [distributed on Nuget](https://www.nuget.org/packages/Ara3D.BimOpenSchema.IO).
4. WPF-Based GUI Sample
## 🌐 Platform and Language Agnostic
The schema is optimized for columnar data formats, such as those used
by relational databases, but it is *not* tied to any one particular serialization format,
and can be easily converted to many different formats for fast inspection in your tool of choice.
This project comes with C# code which acts as the official specification, but the schema is platform independent
and language agnostic.
We welcome code contributions in any language.
## 🎯Target Workflows
1. **ETL pipe** : Revit/IFC -> Parquet -> database/BI/ML.
2. **Quick inspection** : Open the Parquet files with DuckDB, PowerBI, or Pandas.
3. **Inter‑tool hand‑off** : Share a small, self‑contained bundle instead of heavyweight RVT/IFC when geometry is not required.
## 🧑🤝🧑Target Users
Data scientists, BI analysts, and application developers who need properties, relationships, and additional BIM data without
geometry.
## 📐 Design Principles
- _Column‑oriented storage_: Each list maps cleanly to a Parquet column chunk or a database table.
- _String & point interning_: Repeated values are stored once and referenced by a typed index, keeping files small.
- _EAV‑flavoured parameters_: A minimal core (Entity, Descriptor) plus type‑specific value tables yields flexibility while preserving strong types.
- _Relation set_: A single EntityRelation edge list expresses most graph‑like BIM relationships found in Revit or IFC.
## 🤔 What is ETL?
ETL (Extract, Transform, and Load) is a three-phase computing process where data is extracted from an input source,
transformed (including cleaning), and loaded into an output data container.
The goal of BIM Open Schema is to standardize the BIM representation of data for extraction and loading using a schema
that is efficient, compact, and cross-platform. Better ETL means better data analytics.
## 📝Serialization Formats (Readers and Writers)
We provide tools and examples to convert BIM Open Schema to/from:
- [Parquet](https://parquet.apache.org/) - an efficient, open source, column-oriented data file format with wide tooling support.
- [DuckDB](https://duckdb.org/) - A simple, fast, open-source database system optimized for in-process analytical work.
- [JSON](https://json.org) - A lightweight and ubiquitous human-readable format for exchanging data over the web.
To extract data from Revit you can use our **[Revit Parquet Exporter](https://github.com/ara3d/bim-open-schema/releases)**
Or **[Bowerbird](https://github.com/ara3d/bowerbird)** and the command _"Export BIM Open Schema"_:
## 🔗 Related Projects
Some open-source projects which are related:
- [SVF2 to Parquet](https://github.com/wallabyway/vibe-duckdb-svf2-properties)
- [Fragments](https://github.com/ThatOpen/engine_fragment)
- [VIM Format](https://github.com/vimaec/vim-format)
- [IFC5](https://github.com/buildingSMART/IFC5-development)
## 👥 Contributors and Supporters
Supporting and contributing to this project is as simple as [providing feedback](https://github.com/ara3d/bim-open-schema/issues/new?template=feedback.md).
Some of the people who have contributed are (in alphabetical order):
* Ahmad Saleem Z - AnkerDB
* Christopher Diggins - Ara 3D
* Daryl Irvine - DG Jones and Partners
* Karim Daw - Gensler
* Pablo Derendinger - e-verse
* Tom van Diggelen - BIMcollab
* Tomo Sugeta - Cundall
* Valentin Noves - e-verse
* Yskert Schindel - Vyssuals
We have an active Discord server and discussion forum that you can join if you are interested.
Just send us an [email request](mailto:info@ara3d.com)
## 💼 Commercial Support and Services
If you are interesting in professional help in leveraging the format and learning what you can do with it, reach out to
us at [info@ara3d.com](mailto:info@ara3d.com).