RAPIDS Accelerator for Apache Spark v21.10 launched

Developers could also be to know that this month RAPIDS Accelerator for Apache Spark v21.10 has been made out there and the open supply challenge is now out there to obtain. The newest launch features a wealth of neighborhood requests which are ideally suited to GPU acceleration. Such as new efficiency enhancements and price financial savings in addition to new I/O and nested datatype Qualification and Profiling software options along with updates to the spark-examples repository.

The improvement workforce has additionally introduced that upcoming variations will introduce help for 128-bit decimal datatype, inference help for the Principle Component Analysis algorithm and extra nested information sort help for multi-level struct and maps. As properly as MIG help for NVIDIA Ampere Architecture primarily based GPUs (A100/A30) which can assist enhance throughput on working a number of spark jobs with A100. As at all times, we need to thank all of you for utilizing RAPIDS Accelerator for Apache Spark and we look ahead to listening to from you. Reach out to us on GitHub and tell us how we are able to proceed to enhance your expertise utilizing RAPIDS Accelerator on Apache Spark.

RAPIDS Accelerator for Apache Spark

“RAPIDS Accelerator for Apache Spark is rising at an incredible tempo in each performance and efficiency. Standard business benchmarks are a good way to measure efficiency over a time period however one other barometer to measure efficiency is to measure efficiency of frequent operators which are used within the information preprocessing stage or in information analytics. Most Apache Spark customers are conscious that Spark 3.2 was launched this October. The v21.10 launch has help for Spark 3.2 and CUDA 11.4. In this launch, we centered on increasing help for I/O, nested information processing, and machine studying performance. RAPIDS Accelerator for Apache Spark v21.10 launched a brand new plug-in jar to help machine studying in Spark. “

“In addition to the plug-in, multiple new features were also added to RAPIDS Accelerator for Apache Spark’s Qualification and Profiling tool. The Qualification tool can now report the different nested datatypes and write data formats present. It now also includes support for adding conjunction and disjunction filters, and filter based Regular Expressions and usernames. The Qualifications tool is not the only one with new tricks: the Profiling tool now provides structured output format and support to scale and run a large number of event logs.”

For extra info on the brand new options and additions to RAPIDS Accelerator for Apache Spark v21.10 bounce over to the official NVIDIA web site by following the hyperlink under.

Source : NVIDIA

Filed Under: Gadgets News

Latest Geeky Gadgets Deals

Disclosure: Some of our articles embody affiliate hyperlinks. If you purchase one thing by one in every of these hyperlinks, Geeky Gadgets could earn an affiliate fee. Learn extra.