escription and Location
4+ years in data operations, platform support or IT assurance roles.
?Working knowledge on data lake architecture and storage formats
?Understanding of data partitioning, schema evolution and reconciliation
?String proficiency in SQL for any Data quality checks verification
?Ability to write scripts for Data validation and verification during the migration
?Understanding of data governance principle, metadata management and regulatory principles
?Scripting and Automations skills (expertise in Spark, Hive using python)
4年以上工作經(jīng)驗(yàn) 英語溝通
描述與地點(diǎn)
? 在數(shù)據(jù)運(yùn)營、平臺(tái)支持或IT審計(jì)相關(guān)崗位上有4年工作經(jīng)驗(yàn)。
? 熟悉數(shù)據(jù)湖架構(gòu)和存儲(chǔ)格式
? 理解數(shù)據(jù)分區(qū)、模式演變及數(shù)據(jù)對(duì)賬x
? 精通用于數(shù)據(jù)質(zhì)量檢查驗(yàn)證的SQL
? 能夠在遷移過程中編寫數(shù)據(jù)驗(yàn)證和核查腳本
? 理解數(shù)據(jù)治理原則、元數(shù)據(jù)管理及法規(guī)要求? 具備腳本編寫和自動(dòng)化技能(精通使用Python進(jìn)行Spark和Hive操作)