Development of the Predictive Sales Software, including but not limited to: DB Engineering, API Development and integrating with other APIs and services, Python / Flask / bash back-end development, JS / Jinja2 / CSS / AJAX / jquery / html front-end development, technical assistance in customer projects
Cloud connector development, fetching data from different sources, data mapping, uploading into REST API
handling SAP Basis and DB commands and administration in Linux operating system
performing different type of client copies and related activities
db user management : Creating roles, users, privileges, password management
Linux environment SAP system installation and end to end provisioning
Cloud connector development for Predictive Sales Software
Data EngineerPythonFlaskDjango...
Data Engineer
Development of the Predictive Sales Software, including but not limited to: DB Engineering, API Development and integrating with other APIs and services, Python / Flask / bash back-end development, JS / Jinja2 / CSS / AJAX / jquery / html front-end development, technical assistance in customer projects. Cloud connector development, fetching data from different sources, data mapping, uploading into REST API. Creating wrapper application based on Python PyQt5 that users can run on their PC or laptop (Windows and Linux versions), it creates an SSH tunnel and opens the web app behind ssh in its window automatically. Writing unit tests (pytest). Assisting in sales process, creating ssh tunnel, adjusting key-based authentication, preparing mock data, writing documentation, etc. Preparation of the demo video for customers (GNU/Linux, Simplescreenrecorder, FFmpeg, Gnome-Subtitles, Mkvtoolnix) Communication with security vendors about false-positive antivirus alerts on our apps.
Temporary Data Engineering project for the local community (fintech).
gathering requirements from customers
unstructured documents processing using Bash
data quality checking
PythonSQLJavascript basicsUnixfintech
fintech freelance remote
6 months
2022-06 - 2022-11
Short-term project
Sr.DBA / Engineer AWS
(ec2rds)GCP...
Sr.DBA / Engineer
Short-term project related to db and pipelines migration: cloud management, monitoring and troubleshooting, DB Ops. A
writing Python scripts for checking various parameters of each db host from the inventory ? hundreds of servers
ad-hoc monitoring db hosts using UI tools; automating alerting about unexpected events
AWS
(ec2rds)GCPAzureMySQLSQLiteadvanced GNU Linux related stuffbashPythonMONyogZabbixPingdomperconatoolkitsolarwinds (confio) db monitoringfio db testsdb linux servers validation
TCS / SAP Labs remote
2 years
2020-07 - 2022-06
consolidating data from microservices into dwh
Data EngineerPostgresPower BIStitch (etl tool)...
Data Engineer
TheGuarantors, fintech company providing innovative insurance products and financial solutions for residential and commercial real estate professionals as well as their residents and tenants.
Data Science team
AWS (ec2, rds, s3, ses)
consolidating data from microservices into dwh
creating bi dashboards
tuning objects in dwh in order to make them cached
Data Modeling
dba stuff like creating users, setting access rights on different environments, aws rds db replication
looking for missing indexes etc in order to optimize sql queries
checking data quality and integrity, creating various concepts for future usage
creating star-type dwh
creating db functions for financial forecasting
migration from Redshift/Periscope into Snowflake/PowerBI
various performance testing under high load
parsing and joining complex json values in Postgres and Snowflake
preparing documentation, presentations for business users, new team members onboarding (basic)
Achievements:
created custom ETL process based on Python for handling key-based replication deleted records and for cross-instance data quality checks (Postgres vs Redshift and Postgres vs Snowflake)
created custom process based on panda | Python for various data quality checks;
created data pipeline alert process based on Python for notifying users about various events in database, integrated with mailjet (email service) and Slack
created basic frontend subsystem based on Python & Flask for notifications management
created databricks to hubspot API integration using Python
created basic web api based on Flask and Google Cloud
(investigating) PySpark, Parquet, SQLite, Amazon Redshift, Amazon S3 : generating Parquet files using PySpark from different db
types, checking result using SQLite locally, uploading into Amazon and making queries;
(dba) SQL Server: backup, restore, check and interpret audit tables, create users, grant access rights
PostgreSQL RDS and selfhosted instance: enable and configure logical decoding for audit usage
(support) MySQL, basic perl scripting: uploading csv files into remote MySQL API using perl, data validation
(data integration) preparing backend to store Sendgrid API data in PostgreSQL
(dealing with legacy) transforming legacy database into structured and documented one (data science) data cleaning, deduplication, comparing records etc.
(migration) SQL Server -> PostgreSQL (custom scripts); Legacy MySQL -> Prod MySQL (mysqldump); Legacy MySQL -> stage
PostgreSQL (pgloader)
(reporting) dealing with advanced excel-like formulas in Klipfolio in order to pass various input parameters; creating product's
dashboard with essential business values
(linux infrastructure administrating) obtaining https certificate from Let's Encrypt configuring ssh tunnels to access databases
configuring virtual hosting for API
Zealic Solutions remote/hybrid
6 months
2020-01 - 2020-06
Synthetic data / data obfuscation, short-term project
SQL DevData ModelingSQLT-SQL...
SQL Dev
Synthetic data / data obfuscation, short-term project.
Finance company needs to populate big amount of tables with synthetic/obfuscated data (millions of records) while keeping some of them real, so that its clients are able to continue training without personal data.
Soft skills: basic onboarding of new members; involved in basic hr stuf
Data ModelingSQLT-SQLSSISXMLregexpredgate sql data generatorPowerShelladvanced batch scriptingautomated testing (tSQLt)in-memory calculationsTFS (version control)Microsoft Teamspreparing basic documentation
Eleks remote
2 months
2019-04 - 2019-05
designing a database to manage information
Freelance SQL DeveloperSQLT-SQLSQL Server...
Freelance SQL Developer
Freelance network
designing a database to manage information on the collection of various types of taxes writing ad-hoc queries to populate a schema
preparing a presentation to demonstrate working code
SQLT-SQLSQL ServerData Modeling
Toptal remote
2 years 8 months
2016-09 - 2019-04
Data integration remote
SQL DeveloperOracleSQL ServerPostgres...
SQL Developer
AWS (ec2, rds, s3), data integration
creating sql connectors: analyse api (rest/soap) in order to estimate the effort, request
credentials including refresh token etc, fill data in api/ui in order to see final results if no sandbox present, control deprecation and upgrade connector if needed, create/update documentation, support customers (occasionally as main tasks are development), deploy and test (including in UI), creating mock services.
In course of my work I started using Java code for data manipulation using objecttable/teiid.
analyzing user?s requirements
analyzing external REST API & SOAP API documentation
writing connectors code
building server and pipeline UI
writing connector?s documentation
OracleSQL ServerPostgresMySQLSAP HanaRedshift
1 year 10 months
2014-11 - 2016-08
creating and maintaining Oracle database objects required by business
Oracle PL/SQL Developer OracleSQLPL/SQL...
Oracle PL/SQL Developer
L3 support of business users
creating of Oracle database objects documentation
OracleSQLPL/SQLbashperl basicsDWH
PLS logistics services remote/hybrid
3 years 7 months
2011-04 - 2014-10
migration from SAP BI to Oracle BI
Oracle PL/SQL DeveloperOracleSQLPL/SQL...
Oracle PL/SQL Developer
creating BI reports and dashboards
developing and supporting a fraud prevention alarm system for internet banking
DBA tasks such as user creation and access rights assignment to various environments
looking for missing DB indexes, etc., in order to optimize SQL queries
DB parsing and joining of complex JSON values
Creating database and Linux-based system documentation, as well as presentations for business users.
DB data cleaning, deduplication, etc.
automatic data comparison and alerting about differences between multiple database instances
Branchen
Branchen
Banking
Fintech
Healthcare
Logistics
Clouds
Einsatzorte
Einsatzorte
Berlin (+10km)
Deutschland
möglich
Projekte
Projekte
1 year 8 months
2023-04 - now
Development of the Predictive Sales Software
Sr. Data / DB EngineerPythonFlaskSQLAlchemy...
Sr. Data / DB Engineer
Development of the Predictive Sales Software, including but not limited to: DB Engineering, API Development and integrating with other APIs and services, Python / Flask / bash back-end development, JS / Jinja2 / CSS / AJAX / jquery / html front-end development, technical assistance in customer projects
Cloud connector development, fetching data from different sources, data mapping, uploading into REST API
handling SAP Basis and DB commands and administration in Linux operating system
performing different type of client copies and related activities
db user management : Creating roles, users, privileges, password management
Linux environment SAP system installation and end to end provisioning
Cloud connector development for Predictive Sales Software
Data EngineerPythonFlaskDjango...
Data Engineer
Development of the Predictive Sales Software, including but not limited to: DB Engineering, API Development and integrating with other APIs and services, Python / Flask / bash back-end development, JS / Jinja2 / CSS / AJAX / jquery / html front-end development, technical assistance in customer projects. Cloud connector development, fetching data from different sources, data mapping, uploading into REST API. Creating wrapper application based on Python PyQt5 that users can run on their PC or laptop (Windows and Linux versions), it creates an SSH tunnel and opens the web app behind ssh in its window automatically. Writing unit tests (pytest). Assisting in sales process, creating ssh tunnel, adjusting key-based authentication, preparing mock data, writing documentation, etc. Preparation of the demo video for customers (GNU/Linux, Simplescreenrecorder, FFmpeg, Gnome-Subtitles, Mkvtoolnix) Communication with security vendors about false-positive antivirus alerts on our apps.
Temporary Data Engineering project for the local community (fintech).
gathering requirements from customers
unstructured documents processing using Bash
data quality checking
PythonSQLJavascript basicsUnixfintech
fintech freelance remote
6 months
2022-06 - 2022-11
Short-term project
Sr.DBA / Engineer AWS
(ec2rds)GCP...
Sr.DBA / Engineer
Short-term project related to db and pipelines migration: cloud management, monitoring and troubleshooting, DB Ops. A
writing Python scripts for checking various parameters of each db host from the inventory ? hundreds of servers
ad-hoc monitoring db hosts using UI tools; automating alerting about unexpected events
AWS
(ec2rds)GCPAzureMySQLSQLiteadvanced GNU Linux related stuffbashPythonMONyogZabbixPingdomperconatoolkitsolarwinds (confio) db monitoringfio db testsdb linux servers validation
TCS / SAP Labs remote
2 years
2020-07 - 2022-06
consolidating data from microservices into dwh
Data EngineerPostgresPower BIStitch (etl tool)...
Data Engineer
TheGuarantors, fintech company providing innovative insurance products and financial solutions for residential and commercial real estate professionals as well as their residents and tenants.
Data Science team
AWS (ec2, rds, s3, ses)
consolidating data from microservices into dwh
creating bi dashboards
tuning objects in dwh in order to make them cached
Data Modeling
dba stuff like creating users, setting access rights on different environments, aws rds db replication
looking for missing indexes etc in order to optimize sql queries
checking data quality and integrity, creating various concepts for future usage
creating star-type dwh
creating db functions for financial forecasting
migration from Redshift/Periscope into Snowflake/PowerBI
various performance testing under high load
parsing and joining complex json values in Postgres and Snowflake
preparing documentation, presentations for business users, new team members onboarding (basic)
Achievements:
created custom ETL process based on Python for handling key-based replication deleted records and for cross-instance data quality checks (Postgres vs Redshift and Postgres vs Snowflake)
created custom process based on panda | Python for various data quality checks;
created data pipeline alert process based on Python for notifying users about various events in database, integrated with mailjet (email service) and Slack
created basic frontend subsystem based on Python & Flask for notifications management
created databricks to hubspot API integration using Python
created basic web api based on Flask and Google Cloud
(investigating) PySpark, Parquet, SQLite, Amazon Redshift, Amazon S3 : generating Parquet files using PySpark from different db
types, checking result using SQLite locally, uploading into Amazon and making queries;
(dba) SQL Server: backup, restore, check and interpret audit tables, create users, grant access rights
PostgreSQL RDS and selfhosted instance: enable and configure logical decoding for audit usage
(support) MySQL, basic perl scripting: uploading csv files into remote MySQL API using perl, data validation
(data integration) preparing backend to store Sendgrid API data in PostgreSQL
(dealing with legacy) transforming legacy database into structured and documented one (data science) data cleaning, deduplication, comparing records etc.
(migration) SQL Server -> PostgreSQL (custom scripts); Legacy MySQL -> Prod MySQL (mysqldump); Legacy MySQL -> stage
PostgreSQL (pgloader)
(reporting) dealing with advanced excel-like formulas in Klipfolio in order to pass various input parameters; creating product's
dashboard with essential business values
(linux infrastructure administrating) obtaining https certificate from Let's Encrypt configuring ssh tunnels to access databases
configuring virtual hosting for API
Zealic Solutions remote/hybrid
6 months
2020-01 - 2020-06
Synthetic data / data obfuscation, short-term project
SQL DevData ModelingSQLT-SQL...
SQL Dev
Synthetic data / data obfuscation, short-term project.
Finance company needs to populate big amount of tables with synthetic/obfuscated data (millions of records) while keeping some of them real, so that its clients are able to continue training without personal data.
Soft skills: basic onboarding of new members; involved in basic hr stuf
Data ModelingSQLT-SQLSSISXMLregexpredgate sql data generatorPowerShelladvanced batch scriptingautomated testing (tSQLt)in-memory calculationsTFS (version control)Microsoft Teamspreparing basic documentation
Eleks remote
2 months
2019-04 - 2019-05
designing a database to manage information
Freelance SQL DeveloperSQLT-SQLSQL Server...
Freelance SQL Developer
Freelance network
designing a database to manage information on the collection of various types of taxes writing ad-hoc queries to populate a schema
preparing a presentation to demonstrate working code
SQLT-SQLSQL ServerData Modeling
Toptal remote
2 years 8 months
2016-09 - 2019-04
Data integration remote
SQL DeveloperOracleSQL ServerPostgres...
SQL Developer
AWS (ec2, rds, s3), data integration
creating sql connectors: analyse api (rest/soap) in order to estimate the effort, request
credentials including refresh token etc, fill data in api/ui in order to see final results if no sandbox present, control deprecation and upgrade connector if needed, create/update documentation, support customers (occasionally as main tasks are development), deploy and test (including in UI), creating mock services.
In course of my work I started using Java code for data manipulation using objecttable/teiid.
analyzing user?s requirements
analyzing external REST API & SOAP API documentation
writing connectors code
building server and pipeline UI
writing connector?s documentation
OracleSQL ServerPostgresMySQLSAP HanaRedshift
1 year 10 months
2014-11 - 2016-08
creating and maintaining Oracle database objects required by business
Oracle PL/SQL Developer OracleSQLPL/SQL...
Oracle PL/SQL Developer
L3 support of business users
creating of Oracle database objects documentation
OracleSQLPL/SQLbashperl basicsDWH
PLS logistics services remote/hybrid
3 years 7 months
2011-04 - 2014-10
migration from SAP BI to Oracle BI
Oracle PL/SQL DeveloperOracleSQLPL/SQL...
Oracle PL/SQL Developer
creating BI reports and dashboards
developing and supporting a fraud prevention alarm system for internet banking