Role OverviewData engineer specialized in data virtualization with Denodo, responsible for designing, building, and optimizing the semantic layer that exposes governed data products to business consumers, BI tools, and downstream applications.
What You Will Do
Design, build, and maintain the Denodo semantic layer, translate business requirements into governed, reusable views and data products published to the Data Catalog and Data Marketplace.
Why It Might Be a Fit
Collaborate with data governance and security teams to enforce access policies, lineage capture, and metadata quality on every published asset.
Requirements
- Denodo · Semantic Layer & Data Services (mid-expert level)
- Logical modelling and layering: base views, derived views (join, union, selection, projection, aggregation, flatten) and interface views;
- Semantic layer for data products: business-friendly models, certified KPIs and metrics, association and hierarchy definition, field-level descriptions and business metadata;
- Advanced SQL: complex queries, stored procedures, custom functions;
- Query optimization (core requirement): cost-based optimizer, statistics management, query pushdown and delegation to Redshift/Oracle/S3, branch pruning, join strategy selection (merge, hash, nested), partitioned unions, and execution-trace analysis to diagnose and remediate slow queries;
- Acceleration and caching: full, partial and incremental cache strategies, cache refresh scheduling and invalidation, summary views and smart query acceleration, and MPP acceleration over object storage;
- Visualization performance: tuning of the consumption layer for Power BI, Tableau and similar tools: live vs. import trade-offs, aggregate awareness, result set reduction, concurrency and workload management to keep dashboard response times within agreed SLAs;
- Publication and consumption: Data Catalog and Data Marketplace publication, tagging and categorization;
- Security: role-based access control, row level and column level security, masking and data protection policies, and integration with LDAP/AD and SSO;
- Operations: Design Studio, Solution Manager, Scheduler, promotion between environments (git export and import), monitoring of usage and workload, and diagnostics with logs and execution traces;
- Server and environment management: installation and update of Denodo servers, virtual database and project structure, environment topology across Dev, QA and Production, and configuration of server properties and JVM memory settings;
- Metadata promotion and version control: VQL export and import, integration with Git for versioning of views and metadata, revision management, and rollback procedures for failed promotions;
- Data source administration: creation and maintenance of data source connections, driver deployment and upgrades, connection pool sizing, timeouts, and credential handling through the platform vault or an external secret store;
- Cache administration: configuration of the cache database, cache load and refresh policies, scheduling of maintenance jobs, purge of expired cache data, and sizing of the cache store;
- Scheduler: definition and operation of scheduled jobs for cache refresh, exports and extraction tasks, dependency configuration, and handling of job failures;
- Monitoring and diagnostics: use of the Diagnostic and Monitoring Tool, query and resource monitoring, analysis of server and query logs, identification of long running or blocking queries, and configuration of alerts and thresholds;
- Resource management: definition of resource plans and workload rules, concurrency and query limits by role or application, and protection of the server under peak load;
- Backup and continuity: backup of metadata and configuration, restore procedures, high availability and load balancing setup, and participation in disaster recovery testing;
Benefits
- Competitive salary
- Benefits package
- 401(k) match
- Health insurance
- Dental insurance
- Vision insurance
- Paid holidays
- Paid time off
- Flexible work arrangements
- Professional development opportunities
]]>