By using this site, you agree to the Privacy Policy and Terms of Use.
Accept
World of SoftwareWorld of SoftwareWorld of Software
  • News
  • Software
  • Mobile
  • Computing
  • Gaming
  • Videos
  • More
    • Gadget
    • Web Stories
    • Trending
    • Press Release
Search
  • Privacy
  • Terms
  • Advertise
  • Contact
Copyright © All Rights Reserved. World of Software.
Reading: Catch Secrets in Real Time on GitHub with EnvScanner 2.0 and AI | HackerNoon
Share
Sign In
Notification Show More
Font ResizerAa
World of SoftwareWorld of Software
Font ResizerAa
  • Software
  • Mobile
  • Computing
  • Gadget
  • Gaming
  • Videos
Search
  • News
  • Software
  • Mobile
  • Computing
  • Gaming
  • Videos
  • More
    • Gadget
    • Web Stories
    • Trending
    • Press Release
Have an existing account? Sign In
Follow US
  • Privacy
  • Terms
  • Advertise
  • Contact
Copyright © All Rights Reserved. World of Software.
World of Software > Computing > Catch Secrets in Real Time on GitHub with EnvScanner 2.0 and AI | HackerNoon
Computing

Catch Secrets in Real Time on GitHub with EnvScanner 2.0 and AI | HackerNoon

News Room
Last updated: 2025/08/25 at 7:45 AM
News Room Published 25 August 2025
Share
SHARE

Every developer has been there. You’re pushing code at 2 AM, eyes half-shut, and without realizing it — that API key you hardcoded “just for testing” is now sitting in your public GitHub repo.

And just like that, it’s out there.

Leaked secrets are one of the biggest sources of breaches today. From AWS keys to database credentials, once they hit the public GitHub firehose, attackers with automated scanners pick them up within minutes.

That’s where EnvScanner 2.0 comes in.

The Idea Behind EnvScanner 2.0

When I looked at existing secret scanners, I saw two problems:

  1. False positives everywhere. Regex-only scanners scream about anything that looks like a key (even harmless fake values).
  2. Performance issues. Many scanners are too heavy for small servers or can’t keep up with real-time GitHub events.

So I set out to build a proof-of-concept DevSecOps tool that could:

  • Ingest real-time GitHub events
  • Detect possible secrets intelligently
  • Validate them with AI (Google Gemini) to minimize false alarms
  • Run efficiently, even on low-resource machines

The result: EnvScanner 2.0. | https://envscanner.vercel.app


How It Works (Architecture)

EnvScanner 2.0 follows a multi-stage pipeline:

  1. Event Ingestion → Continuously polls the public GitHub /events API.
  2. Memory-Efficient Queuing → Transforms heavy GitHub events into lightweight objects stored in a capped in-memory queue (so it won’t blow up RAM).
  3. File Filtering & Fetching → Ignores non-source files (images, binaries, docs).
  4. Secret Detection → Uses regex + entropy analysis + keyword matching + negative lookaheads to avoid obvious junk.
  5. AI Validation → Potential secrets go to Gemini API, which looks at the context and discards fake/local/test credentials.
  6. Storage & Display → Validated secrets are stored in MongoDB and shown on a live React dashboard via WebSockets.

💻 Tech Stack

| Area | Tech |
|—-|—-|
| Backend | Node.js, Fastify, TypeScript, Mongoose, WebSockets |
| Frontend | React, Vite, Tailwind, GSAP, Material-UI |
| Database | MongoDB |
| AI | Google Gemini API |
| Deployment | PM2, Cloudflare Tunnels |


Performance Optimizations

I wanted this to run even on a 512MB server. Here’s how:

  • Concurrency Limiting with p-limit → prevents CPU/memory spikes.
  • Aggressive Timeouts → no getting stuck on slow file fetches.
  • Memory-Efficient Queuing → lightweight event objects only.
  • Blacklist Filtering → skips “junk” files like images and binaries.

The Frontend Dashboard

The React + WebSocket frontend shows:

  • Live event stream
  • Current scan activity
  • API rate limit status
  • Newly discovered + AI-validated secrets

It’s responsive, so you can monitor leaks in real-time from your laptop or phone.


Why This Matters

This project isn’t meant to replace enterprise-grade tools like GitGuardian or CloudSEK (they’re doing amazing work in this space). Instead, EnvScanner 2.0 is a proof of concept — showing how lightweight engineering + AI validation can make DevSecOps tools both smarter and more resource-friendly.

Secrets leaking on GitHub isn’t slowing down anytime soon. My hope is that experiments like this push the ecosystem toward fewer false positives, more automation, and smarter validation.


Final Thoughts

EnvScanner 2.0 started as a late-night experiment and turned into a full-stack project that I’m genuinely proud of.

If you’re curious about the project or want to collaborate on improving it — feel free to reach out. Always open to feedback from the security and dev communities.

Because at the end of the day, keeping secrets safe is everyone’s responsibility.

Sign Up For Daily Newsletter

Be keep up! Get the latest breaking news delivered straight to your inbox.
By signing up, you agree to our Terms of Use and acknowledge the data practices in our Privacy Policy. You may unsubscribe at any time.
Share This Article
Facebook Twitter Email Print
Share
What do you think?
Love0
Sad0
Happy0
Sleepy0
Angry0
Dead0
Wink0
Previous Article Why Rust Will Help You Deliver Better Low-latency Systems and Happier Developers
Next Article Oppo Find X9 Pro Specifications And Price In India Tipped Ahead Of Launch This Year: Check Here
Leave a comment

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Stay Connected

248.1k Like
69.1k Follow
134k Pin
54.3k Follow

Latest News

What to Watch on Netflix in September 2025
News
I Turned Off My Smart TV’s Always-Listening Mic and I’m Glad I Did
Computing
“HwuhBkshgSBusnss”Gusby.
News
Xreal’s futuristic AR glasses are finally available at Amazon and Best Buy
News

You Might also Like

Computing

I Turned Off My Smart TV’s Always-Listening Mic and I’m Glad I Did

10 Min Read
Computing

Why Visa is building a $54 million data centre in South Africa

7 Min Read
Computing

Marketing Is Psychological Warfare: How to Sell in a World Full of Noise | HackerNoon

6 Min Read
Computing

Why SIEM Rules Fail and How to Fix Them: Insights from 160 Million Attack Simulations

10 Min Read
//

World of Software is your one-stop website for the latest tech news and updates, follow us now to get the news that matters to you.

Quick Link

  • Privacy Policy
  • Terms of use
  • Advertise
  • Contact

Topics

  • Computing
  • Software
  • Press Release
  • Trending

Sign Up for Our Newsletter

Subscribe to our newsletter to get our newest articles instantly!

World of SoftwareWorld of Software
Follow US
Copyright © All Rights Reserved. World of Software.
Welcome Back!

Sign in to your account

Lost your password?