Skip to main content

Posts

Top 7 Tools for Building Data Pipeline

 There are several state-of-the-art tools available for building data pipelines. Here are some of the most popular ones: 1. Apache Airflow: Apache Airflow is an open-source platform for creating, scheduling, and monitoring workflows. It allows users to define complex workflows as code and provides a web-based interface for managing and monitoring them. 2. Apache Kafka: Apache Kafka is a distributed streaming platform that allows users to publish and subscribe to streams of records. It is commonly used for building real-time data pipelines and processing large volumes of data. 3. Apache NiFi: Apache NiFi is an open-source data integration platform that allows users to automate the flow of data between systems. It provides a web-based interface for designing and managing data flows and supports a wide range of data sources and destinations. 4. AWS Glue: AWS Glue is a fully managed ETL service that allows users to extract, transform, and load data from various sources into AWS data st...
Post a Comment
Read more
Recent posts

Data Lake Vs. Data Warehouse

"Data Lake" has become a buzzword over the past few years. In this age of big data where the volume of data is being increased day by day with rocket-like velocity and an enormous amount of varieties because of the increased use of streaming data, mobile, sensor data, etc., "Data Lake" has poised the headlines in the data community. So, it's important to know what "Data Lake" is. And here comes the human misconception where some of us mistakenly believe that "Data Lake" is just the Version 2.0 of the existing data storage system "Data Warehouse" and it's popular because of marketing hype. Though data warehouse or data lake both the entities store data but the data lake is fundamentally different from the data warehouse. And this article is about breaking that misconception and knowing the detail difference between the two. What is Data Warehouse? Is Data Warehouse Not Important Today? The traditional data warehouses ar...
Post a Comment
Read more

5 What Will Be Output Examples in Core Java String

Java Version Used: JDK 1.7 Program 1: public static void main(String[] args){ String s1 = "abc"; String s2 = "abc"; System.out.println("s1 == s2 is:" + s1 == s2); } Output: false Explanation: Though here s1 object is equal to s2, the output will be false as here it's comparing the below strings for equality. s1 == s2 is:abc abc Program 2: public static void main(String[] args){ String s1 = "abc"; String s2 = "abc"; System.out.println(s1 == s2); } Output: True Program 3: public static void main(String[] args){ String s1 = "abc"; String s2 = "abc"; System.out.println("s1 == s2 is:" + (s1 == s2)); } Output: s1 == s2 is:true Program 4: public static void main(String[] args){ String s1 = "abc"; String s2 = "abc"; System.out.println("s1.equals(s2) is:" + s1.equals(s2)); } Output: s1.e...
Post a Comment
Read more

10 Common Core Java Programs with Code

10 Common Core Java Programs with Code Problem:1 Converting a decimal number to Binary Number. Code: import java.io.*; import java.util.*; import java.text.*; import java.math.*; import java.util.regex.*; public class Solution {     public static void main(String[] args) {         Scanner in = new Scanner(System.in);         int n = in.nextInt();         convertDecToBinary(n);     }     public static void convertDecToBinary(int a){         ArrayList<Integer> arr = new ArrayList<Integer>();         while(a > 0){             arr.add(a%2);             a = (int) a/2;         }         Collections.reverse(arr);         System.out.println(arr);     } }
Post a Comment
Read more

Open Source Basics

If you are an avid coder and willing to contribute to open source either for the sake of humanity or to showcase your talent to big firms or any other reason and you are passionate to have a great Github profile, this article is for you. Congratulations!! You have matched all prerequisites. Now it's time to start. What is Open Source? Wikipedia Definition: Open-source software (OSS) is a type of computer software in which source code is released under a license in which the copyright holder grants users the rights to study, change, and distribute the software to anyone and for any purpose. Source: https://en.wikipedia.org/wiki/Open-source_software Opensource.com Definition: The term "open source" refers to something people can modify and share because its design is publicly accessible. The term originated in the context of software development to designate a specific approach to creating computer programs. Today, however, "open sour...
Post a Comment
Read more