Neosync empowers developers with an open-source solution for data anonymization and synthetic data orchestration. Safeguard sensitive production data while enhancing your testing and debugging processes. Create high-fidelity synthetic datasets that ensure compliance with GDPR, HIPAA, and other regulations, enabling you to develop confidently in any environment.
Neosync is your go-to open-source solution for data anonymization and synthetic data orchestration tailored specifically for developers. With Neosync, you can effortlessly create high-fidelity synthetic data and synchronize it across various environments, enhancing your testing, debugging, and overall developer experience.
Key Benefits of Neosync
Companies leverage Neosync to achieve several critical objectives:
- Safely Test Code Against Production Data - Utilize anonymized sensitive production data locally, enabling thorough testing while protecting privacy.
- Reproduce Production Bugs Locally - Generate safe, representative datasets from production data to efficiently recreate and resolve production bugs.
- Enhance Quality in Lower-Level Environments - Proactive bug detection is made possible by hydrating your staging and QA environments with production-like data.
- Ensure Compliance Across Regulations - Use anonymized and synthetic data to simplify adherence to regulations such as GDPR, DPDP, FERPA, HIPAA, and more.
- Seed Development Databases - Efficiently populate development databases with synthetic data for unit testing, demos, and additional use cases.
Features and Capabilities
- Synthetic Data Generation: Create synthetic data tailored to your schema requirements.
- Data Anonymization: Transform existing production data for improved developer usability.
- Database Subsetting: Utilize SQL queries to subset production databases for local and CI testing.
- Asynchronous Pipeline Management: Automate job retries, handle failures, and implement seamless playback with an event-sourcing approach.
- Maintaining Referential Integrity: Ensure your data relationships remain intact throughout the process.
- Declarative GitOps Configurations: Incorporate GitOps-based configurations into your CI pipeline for streamlined database hydration.
- Pre-Built and Custom Data Transformers: Leverage pre-built data transformers for all major data types or create custom transformations using JavaScript or LLMs.
- Integrations with Major Databases and Storage: Out-of-the-box support for Postgres, MySQL, and S3 to facilitate your data operations.
Getting Started
Neosync features a fully dockerized setup to simplify deployment. With just a few commands, you can have Neosync running locally. To start, clone the repository and run:
make compose/up
To stop Neosync, execute:
make compose/down
Once running, you can access Neosync at http://localhost:3000.
Additional Resources
For comprehensive guidance and support, explore our resources:
- Documentation: Detailed guides are available at Docs.
- Community Support: Join discussions in our Discord channel.
- News & Updates: Follow us on X for the latest news.
Join Us!
We welcome contributions of all types! If you have questions or want to get involved, head over to our Discord community, or consider opening a pull request with your ideas.