https://github.com/diskoverdata/diskover-community

Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch
https://github.com/diskoverdata/diskover-community

crawler disk-space disk-space-analyzer disk-usage duplicate-files duplicatefilefinder elasticsearch file-indexing file-manager file-tagging filesystem filesystem-analysis filesystem-indexer filesystem-visualization metadata php python storage storage-analytics web-application

Last synced: 35 minutes ago
JSON representation

Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch

• Host: GitHub
• URL: https://github.com/diskoverdata/diskover-community
• Owner: diskoverdata
• License: apache-2.0
• Created: 2017-04-19T11:17:12.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2024-09-06T02:36:54.000Z (3 months ago)
• Last Synced: 2024-10-29T15:20:07.384Z (about 1 month ago)
• Topics: crawler, disk-space, disk-space-analyzer, disk-usage, duplicate-files, duplicatefilefinder, elasticsearch, file-indexing, file-manager, file-tagging, filesystem, filesystem-analysis, filesystem-indexer, filesystem-visualization, metadata, php, python, storage, storage-analytics, web-application
• Language: PHP
• Homepage: https://diskoverdata.com
• Size: 33.5 MB
• Stars: 1,447
• Watchers: 54
• Forks: 162
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Security: SECURITY.md

Awesome Lists containing this project

• awesome-datahoarding - diskover
• project-awesome - diskoverdata/diskover-community - Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch (PHP)
• awesome-starred - diskoverdata/diskover-community - Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch (python)

README

        
# Diskover Community Edition - Open source file indexer, file search engine and data management and analytics powered by Elasticsearch

[![GitHub issues](https://img.shields.io/github/issues/diskoverdata/diskover-community)](https://github.com/diskoverdata/diskover-community/issues)

[![GitHub forks](https://img.shields.io/github/forks/diskoverdata/diskover-community)](https://github.com/diskoverdata/diskover-community/network)

[![GitHub stars](https://img.shields.io/github/stars/diskoverdata/diskover-community)](https://github.com/diskoverdata/diskover-community/stargazers)

[![GitHub license](https://img.shields.io/github/license/diskoverdata/diskover-community)](https://github.com/diskoverdata/diskover-community/blob/master/LICENSE)

[![GitHub releases](https://img.shields.io/github/release/diskoverdata/diskover-community)](https://github.com/diskoverdata/diskover-community/releases)



diskover is an open source file system indexer that uses Elasticsearch to index and manage data across heterogeneous storage systems. Using diskover, you are able to more effectively search and organize files and system administrators are able to manage storage infrastructure, efficiently provision storage, monitor and report on storage use, and effectively make decisions about new infrastructure purchases.

As the amount of file data generated by businesses continues to expand, the stress on expensive storage infrastructure, users and system administrators, and IT budgets continues to grow.

Using diskover, users can identify old and unused files and give better insights into data change, file duplication and wasted space. diskover supports crawling local file-systems, crawling NFS/SMB, cloud storage, etc. Plugins can be used for adding additional meta data.

diskover runs on Linux, macOS and Windows and is written in Python. Diskover's web app, diskover-web, is written in PHP, Javascript, HTML5 and CSS.

## Screenshots









## Requirements

- Python 3.5+

- PHP 7.4 + PHP-FPM

- Nginx

- Elasticsearch 7.x

## Download

```sh

git clone https://github.com/diskoverdata/diskover-community.git

```

- See [releases](https://github.com/diskoverdata/diskover-community/releases) to download latest stable version in zip or tar.gz. 

- diskover ce v2 linuxserver.io docker container. Download on [docker hub](https://hub.docker.com/r/linuxserver/diskover) or [lsio github](https://github.com/linuxserver/docker-diskover).

- diskover ce v2 on [AWS Marketplace](https://aws.amazon.com/marketplace/pp/prodview-ahatamjklfgk4?sr=0-1&ref_=beagle&applicationId=AWSMPContessa)

## News/ Updates

- v1 is end of life and is no longer supported.

## Install/User Guide

[Read the docs](https://docs.diskoverdata.com/) for more documentation on how to install and use diskover.

## Changelogs

[Changelogs](https://docs.diskoverdata.com/diskover_changelogs/)

## Discussions/Support

For discussions or support for diskover join the [diskover Slack workspace](https://join.slack.com/t/diskoverworkspace/shared_invite/enQtNzQ0NjE1Njk5MjIyLWI4NWQ0MjFhYzQyMTRhMzk4NTQ3YjBlYjJiMDk1YWUzMTZmZjI1MTdhYTA3NzAzNTU0MDc5NDA2ZDI4OWRiMjM).

## Bugs

For bugs about diskover, please use the [issues page](https://github.com/diskoverdata/diskover-community/issues).

## Security

See the [security file](https://github.com/diskoverdata/diskover-community/blob/master/SECURITY.md).

## License

See the [license file](https://github.com/diskoverdata/diskover-community/blob/master/LICENSE).