The automated service handles Parquet-formatted datasets stored in Amazon S3 and registered in the AWS Glue Data Catalog. By eliminating manual steps like file recompression, type conversions, and data validation, migrations that once took weeks can now proceed with minimal disruption. Production operations stay active until a brief final pause of only a few minutes is required for the cutover. Users are billed exclusively for the data copied during the transfer, with no extra charges levied for the format transformation itself.
Key points
Customers can modernize legacy data architectures without building custom extraction and…: Customers can modernize legacy data architectures without building custom extraction and transformation pipelines or managing compute.
Upgraded datasets integrate immediately with Amazon Athena, Amazon SageMaker Unified Stud…: Upgraded datasets integrate immediately with Amazon Athena, Amazon SageMaker Unified Studio, and tools supporting the Apache Iceberg REST API.
Migrations can be configured and launched via the Amazon S3 console, AWS CLI, AWS SDKs, o…: Migrations can be configured and launched via the Amazon S3 console, AWS CLI, AWS SDKs, or the Agent Toolkit for AWS.
Sources checked by our analysis pipeline: 1
AWS News Blog
Amazon S3 Tables now offer managed migration of Apache Hive tables to Apache Iceberg
|
Today, we’re announcing a simple, cost-effective path for data lake modernization. Amazon S3 Tables now support managed migration of your Apache Hive tables to Apache Iceberg. Migration works with Parquet tables in Amazon S3 that are registered in the AWS Glue Data Catalog and allows you to upgrade your data lake with no pipelines to build or compute to provision, while production workloads keep running.
Apache Iceberg has become the open standard for large analytics datasets. It lets you manage petabyte-scale tables with features like schema evolution, hidden partitioning, and time travel queries, while keeping your data open and queryable with any Iceberg-compatible engine. Amazon S3 Tables offer fully managed storage purpose-built to keep Iceberg tables performant and cost-effective as they grow, with features like automatic maintenance, optimization, replication, and S3 Intelligent-Tiering built-in.
What is new
Previously, migrating Apache Hive tables to Apache Iceberg could take weeks of engineering work to build and manage the required infrastructure. Converting data types and building…
The platform overhauled its underlying infrastructure to streamline web access across varying network speeds. Engineered to aid visitors on sluggish connections, the rewrite unifies fragmented systems to cut loading friction worldwide. Early feedback indicates noticeable responsiveness gains as the rollout gradually expands across international regions.
Lawmakers in New South Wales warn that current planning guidelines critically underestimate the surging water and power demands of technology infrastructure projects. The findings highlight a contentious political battle ahead of the state's upcoming March election as major operators expand their footprints. Despite severe resource warnings, officials chose policy reform over halting ongoing sector developments.
The open-source project has integrated stateful processing into its low-latency execution model, allowing developers to run complex real-time applications directly within Structured Streaming APIs. This architectural overhaul removes traditional staging bottlenecks to support workloads like fraud detection and device monitoring without requiring supplementary streaming engines. Additionally, the project is accelerating development cycles to roll out continuous improvements much faster to enterprise environments.