Bigdata Solutions Architect here. 5+ YearsOfExperiece in building data intensive applications using BigData stack. Rich experience in streaming & batch processing tools like Apache Spark, Apache Kafka. Building all forms of data oriented solutions such as data storages using Databricks delta lake, MinIO, Hadoop/Hdfs, HBase; OLAP over Hive, Hadoop M/R, Apache Kylin, Pinot, Yandex ClickHouse; Lamba Architecture, Keppa Architecture, Multi-tenant Systems.
* Greatly experienced in building systems which perform and scale to demands. From Node.js/Socket.IO to full fledge streaming solutions like Apache Kafka, Spark Streaming, MQTT, NATS.
* Batch processing using Spark, Hadoop M/R.
* Graphing systems like Memgraph, Stardog, OrientDB, Apache Gremlin.
* ETL/ELT over Apache Beam, Arrow, Python, SSIS, Talend.
* Microsoft BI Suite: SSRS, SSIS, PowerBI, SSMS
* Relational: PostgreSQL, TimescaleDB.
* NonRelational: MongoDB, OrientDB, MemgraphDB.
* Searching Solutions: Apache Solr, Lucene, FlexSearch/Node.js.
* In demand, highly valued skills like Python/Flask, Scala/Java/SpringBoot, Node.js/Typescript/NestJs, GoLang.