Thursday, 12 November 2020 15:01

AWS speeds data prep with DataBrew

0
Shares
By

Amazon Web Services' AWS Glue DataBrew is a no-code tool for cleaning and normalising data.

AWS Glue already provides code-based and visual interfaces to simplify ETL processes, and Glue DataBrew adds a way to clean and transform data without writing code.

It works with AWS data lakes, data warehouses and databases including S3, Redshift, Aurora and RDS.

DataBrew provides more than 250 pre-built transformations to automate data preparation tasks such as filtering anomalies, standardising formats, and correcting invalid values.

Examples include normalising data to standard date and time values, generating aggregates for analyses, and correcting invalid, misclassified, or duplicative data. Natural language processing capabilities make it possible to perform more sophisticated transformations.

Assembled steps can be saved as "recipes" for future reuse.

Prepared data is published to Amazon S3, ready for use in analytics and machine learning applications.

AWS Glue DataBrew is serverless and fully managed, and is charged on an pay-by-use basis when creating and running transformations on datasets.

“AWS customers are using data for analytics and machine learning at an unprecedented pace. However, these customers regularly tell us that their teams spend too much time on the undifferentiated, repetitive, and mundane tasks associated with data preparation,” said AWS vice president of database and analytics Raju Gulabani.

“Customers love the scalability and flexibility of code-based data preparation services like AWS Glue, but they could also benefit from allowing business users, data analysts, and data scientists to visually explore and experiment with data independently, without writing code.

"AWS Glue DataBrew features an easy-to-use visual interface that helps data analysts and data scientists of all technical levels understand, combine, clean, and transform data.”

AWS Glue DataBrew is generally available today in various AWS regions including Asia Pacific (Sydney), with wider availability coming soon.


Subscribe to ITWIRE UPDATE Newsletter here

Now’s the Time for 400G Migration

The optical fibre community is anxiously awaiting the benefits that 400G capacity per wavelength will bring to existing and future fibre optic networks.

Nearly every business wants to leverage the latest in digital offerings to remain competitive in their respective markets and to provide support for fast and ever-increasing demands for data capacity. 400G is the answer.

Initial challenges are associated with supporting such project and upgrades to fulfil the promise of higher-capacity transport.

The foundation of optical networking infrastructure includes coherent optical transceivers and digital signal processing (DSP), mux/demux, ROADM, and optical amplifiers, all of which must be able to support 400G capacity.

With today’s proprietary power-hungry and high cost transceivers and DSP, how is migration to 400G networks going to be a viable option?

PacketLight's next-generation standardised solutions may be the answer. Click below to read the full article.

CLICK HERE!

WEBINAR PROMOTION ON ITWIRE: It's all about webinars

These days our customers Advertising & Marketing campaigns are mainly focussed on webinars.

If you wish to promote a Webinar we recommend at least a 2 week campaign prior to your event.

The iTWire campaign will include extensive adverts on our News Site itwire.com and prominent Newsletter promotion https://www.itwire.com/itwire-update.html and Promotional News & Editorial.

This coupled with the new capabilities 5G brings opens up huge opportunities for both network operators and enterprise organisations.

We have a Webinar Business Booster Pack and other supportive programs.

We look forward to discussing your campaign goals with you.

MORE INFO HERE!

BACK TO HOME PAGE
Stephen Withers

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.

Latest from Stephen Withers

Related items

More in this category: « Do we really need a Blockchain?
Share News tips for the iTWire Journalists? Your tip will be anonymous