About Streaming algorithm: Flajolet Martin Algorithm

Published on 2024-11-10

I love streaming algorithms - they make you think! Since they can process data in (near) real-time, they are ideal for applications where immediate feedback is needed. Most of today's recommendation or machine learning systems are built on batch process, however.

Could be Interesting! Big Data Data Science


Have you ever wondered how fast "username is not available" is returned when creating a new account?

Published on 2023-01-30

In any system, there are millions and millions of users record. How could a system tells username is not available almost instantly. Enter Bloom Filter. 😎

Could be Interesting! Big Data

Motivation

We all have our preferred learning style. For me, when it comes to learning, I am more of a read, learn and do person. I prefer reading the materials than watching an hour long video. I believe reading gives me time to absorb and digest the knowledge, then, think of the potential implications. However, learning without an implementation is just an entertainment. So, I built and wired up this site to reflect my learnings. (Utilized Flask Framework, containerized with Docker and first deployed on AWS in Jan 2023).

Disclaimers: By no means, my write-ups are absolute truth. There are many different ways to achieve something. Besides, technology is always evolving and some of my posts might be outdated but fundamentals stay the same.

Categories

Big Data Computer Vision Could be Interesting! Data Science Docker Flask IoT Networking WebTech