Release Notes

Release notes for currently supported releases

Use of HEAVY.AI is subject to the terms of the HEAVY.AI End User License Agreement (EULA).

The latest release of HEAVY.AI is 8.1.2 (RHEL) and 8.1.3 (Ubuntu).

Currently Supported Releases

8.3.0 | 8.2.0 | 8.1.2 & 8.1.3 | 8.1.1 | 8.0.2 | 8.0.1 | 8.0.0 | 7.2.4 | 7.2.3 | 7.2.2 | 7.2.1 | 7.2.0 | 7.1.2 | 7.1.1 | 7.1.0 | 7.0.2 | 7.0.1 | 7.0.0

For release notes for releases that are no longer supported, as well as links to documentation for those releases, see Archived Release Notes.

As with any software upgrade, it is important to back up your data before you upgrade HEAVY.AI. In addition, we recommend testing new releases before deploying in a production environment.

For assistance during the upgrade process, contact HEAVY.AI Support by logging a request through the HEAVY.AI Support Portal.

Release 8.x.x

IMPORTANT - In HeavyDB Release 8.x.x, the system catalog is automatically migrated to support the new Column Level Security feature. This migration is necessary regardless if you intend to use this feature or not. Once the system catalog has been migrated in this manner, it is not backwards-compatible with earlier versions of HeavyDB. If you revert to an earlier version in this state, the system will be in an unstable state and manual intervention will be required. We recommend backing up your data before you upgrade HEAVY.AI.

8.x.x introduces a new licensing version that feature two new types of licenses: Node Locked Licenses and Floating Licenses. Enterprise customers that are upgrading to the 8.x release of HEAVY.AI are required to reach out to the HEAVY.AI Customer Success team for a new license before attempting to upgrade.

Release 8.3.0

HeavyDB - New Features and Improvements

Optimizes concurrent access and caching of table data during query execution.
Optimizes string dictionary memory allocations
Adds a validation to ensure that raster import/HeavyConnect with floating point coordinate types are either world or file space transformed.

HeavyDB - Fixed Issues

Fixes a crash that could occur when attempting to import or HeavyConnect to Apache Spark generated empty Parquet files.
Fixes a crash that could occur when attempting to import or HeavyConnect to Parquet files containing Null columns.
Fixes a potential race condition that could occur when the Executor Resource Manager is enabled.
Fixes an exception that could occur for log based system tables when the log directory contains unexpected files.

HeavyImmerse - New Features and Improvements

Support for customizable color mappings across charts, including Combo, Pointmap, Linemap, Choropleth, Scatterplot, Pie, and Bubble, enabling consistent and tailored color schemes for enhanced visual control. Users can create, import, manage, and apply mappings, with options to save changes, delete mappings, or reset to default hash coloring as needed.
Uses Hash Coloring to ensure consistent color assignment for the same column values across all charts and dashboards.
Unified, default Categorical Colors palette is now used across all supported charts, ensuring out-of-the-box consistency in visualizations.
The previous "Color Set 2" palette has been integrated into the Categorical Colors palette set to streamline options and reduce confusion.

Release 8.2.0

HeavyDB - New Features and Improvements

ARM support
Security updates and fixes

HeavyDB - Fixed Issues

Fixes a crash that could occur when executing queries against ODBC backed foreign tables with negative decimal column values.

HeavyImmerse - Fixed Issues

Updated web server dependencies to improve security

Release 8.1.2 (RHEL) & 8.1.3 (Ubuntu)

HeavyDB - New Features and Improvements

Improves memory utilization for queries with APPROX_COUNT_DISTINCT function calls
Significantly faster columnarization of "lazy fetched" result set data for multi-step queries
Significantly faster string operations, particularly for high-cardinality string inputs (3X+ speedups in some cases)

HeavyDB - Fixed Issues

Fixes an error where users without column level privileges could not access views
Fixes a crash that could occur for queries that order by none encoded text expressions
Fixes an issue where wrong results could be returned for repeated queries with joins on encoded text column expressions
Fixes an error that could occur when large integer values are used in row level security policies
Fixes a CUDA 700 crash that could occur for left join queries with geospatial function predicates

HeavyImmerse - Fixed Issues

Fix side panel overlay issue for time-picking filter.

HeavyIQ / HeavyLM - New Features and Improvements

Allow support for Guidance without an embedding server.
Support FAISS as an alternative to ChromaDB for embeddings.

HeavyIQ / HeavyLM - New Features and Improvements

Various minor improvements and enhancements

Release 8.1.1

HeavyDB - New Features and Improvements

Improves memory management for import requests
Improves performance of group by queries through expanded use of shared memory
Improves performance of low cardinality group by queries
Improves performance of queries with sort on encoded string column expressions
Improves performance of result set reductions
Optimizes memory utilization and performance for sort queries
Adds more instrumentation around memory utilization
Adds support for ST_Centroid function calls with MULTILINESTRING column type arguments

HeavyDB - Fixed Issues

Fixes an issue where S3 imports would not roll back correctly in certain error cases
Fixes an error where repetition of certain geo join queries could result in excessive memory utilization

HeavyImmerse - New Features and Improvements

Make Dashboard configuration panel resizeable.
Add UI customization options for Cloud Edition.

HeavyImmerse - Fixed Issues

Fix scrolling bug with Guidance Snippet list.
Improve handling for loading a database with no tables.
Fix map points display issue on first render.

Heavy IQ / HeavyLM - New Features and Improvements

Add support for a vLLM Embedding server.

HeavyIQ / HeavyLM - Fixed Issues

Fix ChromaDB configuration issues.

Release 8.1.0

HeavyDB - New Features and Improvements

Added LLM_TRANSFORM operator, allowing access to large language model inference within SQL
Adds support for bounding box clipping when importing geospatial files
Retries estimation queries on CPU if the initial query execution fails on GPU due to out of memory errors
Improves the error message that is logged when table data file reads result in errors

HeavyDB - Fixed Issues

Fixes a crash that could occur when Parquet backed foreign tables reference incompatible files
Fixes an issue where spatial transforms were not applied correctly for some raster files containing sub-datasets
Fixes an issue where some string functions would result in error responses when used in predicates and update and delete queries

HeavyRender - New Features and Improvements

Significantly reduced GPU render memory usage and improved performance when rendering complex polygon data
Internal restructuring laying groundwork for improved concurrency between HeavyDB and Heavy Render

HeavyRender - Fixed Issues

Fixed an issue where some GPUs would fail to identify a useful GPU memory heap reporting 0 available memory
Fixed a crash that could occur if a table involved in a query is removed between a render and a later hit-test query (mouse rollover in Immerse)
Fixed a crash that could occur during renderer shutdown and restart if an out of GPU memory error occurs during certain buffer allocation operations

HeavyImmerse - New Features and Improvements

Manage Table and Column Comments in Data Manager
Immerse theming control panel
Add alternative geocoder support using custom location list from a CSV
Add support for custom AWS Regions

HeavyImmerse - Fixed Issues

Fix layer ordering label change after layer switching
Fixed the addition of the last categorical color not being used in color by measure
Make SQL Notebook line charts use GMT instead of local timezone

HeavyIQ / HeavyLM - New Features and Improvements

Added Column Preview summarizing for columns in SQL Notebook source list.
New Log File viewing for IQ Startup and IQ Build log tiles
Improvements to SQL Notebook UI
BETA: Added the new Guidance feature in the HeavyIQ SQL Notebook, powered by HeavyLM's advanced LLM service, provides contextual recommendations and real-time insights for optimized query generation and analysis.
Improved the SQL tool with optimized top-k calculations for string columns, adjusted default settings for cardinality thresholds, and added support for multiline comments in schema caching.

Release 8.0.2

HeavyIQ / HeavyLM - New Features and Improvements

Improve runtime support for Python versions > 3.10.

HeavyIQ / HeavyLM - Fixed Issues

Various performance improvements and fixes.

Release 8.0.1

HeavyDB - New Features and Improvements

Relaxes Coordinate Reference System validations that occur on geospatial data import.
Adds support for a DOT_PRODUCT function with array parameters, which can be used to compute the similarity between arrays (vectors)

HeavyDB - Fixed Issues

Fixes an issue where cross database queries could result in use of incorrect string dictionaries.
Fixes an issue where Host IDs could not be generated on OCI instances.
Fixes an issue where database switching resulted in errors on certain server configurations.
Fixes a CUDA 700 crash that could occur due to incorrect internal caching.
Fixes a parsing error that could occur when projecting array literals with the same element data types.
Fixes an issue where updates via subqueries with non unique rows could result in the wrong error message.
Fixes a crash that could occur when using the CARDINALITY function in certain cases.
Fixes a crash that could occur for certain query patterns involving casts to a REAL data type.
Fixes a crash that could occur for queries with certain case expression patterns involving DATE data types.
Fixes a crash that could occur in certain cases where resultset caching is enabled.
Fixes a crash that could occur for queries that specify LIMIT clauses with floating point values.
Fixes an issue where sql_validate requests with queries containing WIDTH_BUCKET function calls with subquery arguments can result in an error.
Fixes a crash that could occur for certain query patterns with subqueries that include LIMIT and/or OFFSET clauses.

HeavyRender - Fixed Issues

Fix to return null hit-test result if not found.
Fixed an 8.0.0 issue with render gpu selection that would trigger a crash when using the start-gpu program option
Fixed a rare 8.0.0 issue with free GPU memory detection on systems with resizable BAR enabled

Heavy Immerse - New Features and Improvements

Enable HeavyIQ SQL Notebook for Free Edition.

Heavy Immerse - Fixed Issues

Fix to show “Column not found” error text in a raster chart pop-up instead of crashing chart when hit-test column is not found.
Fix for crossfiltering of Number chart when filtering on a Combo chart with a custom SQL base dimension.
Change feature flag from “ui/hide_charts_headers” to “ui/hide_text_chart_headers” and only hide headers on Text charts.
Fix to set priority colors in Pointmap charts.
Update categorical legend domain on map chart zoom.
Fixes regression with prioritized color layers.

HeavyIQ / HeavyLM - New Features and Improvements

Enable HeavyIQ for Free Edition.
Improved caching and processing of table and column metadata.

Release 8.0.0

8.0.0 introduces a new licensing version that feature two new types of licenses: Node Locked Licenses and Floating Licenses. Enterprise customers that are upgrading to the 8.0.0 release of HEAVY.AI are required to reach out to the HEAVY.AI Customer Success team for a new license before attempting to upgrade.

HeavyDB - New Features and Improvements

SELECT privileges are now required in order to execute UPDATE or DELETE commands.
Adds a new "columns" system table that contains information about all table columns across all databases.
Adds support for foreign tables that are backed by raster files.
Adds a new raster import mechanism that stores raster data in a tiled format. This can be enabled by setting the "enable-legacy-raster-import" HeavyDB server configuration parameter to false.
Adds support for column level SELECT privileges.
Adds support for comments on tables.
Adds support for comments on columns.
Adds support for null value filtering on raster import.
Adds MULTIPOLYGON to MULTIPOLYGON ST_Contains function support.
Improves performance for certain query patterns with BETWEEN predicate clauses.
Enables the "use-cpu-mem-pool-for-output-buffers" HeavyDB server configuration parameter by default.
Updates the default value for the "ndv-group-estimator-multiplier" HeavyDB server configuration parameter.

HeavyDB - Fixed Issues

Fixes a crash that could occur in the load_table_binary_columnar Thrift API when request payloads are malformed.
Fixes a crash that could occur in the detect_column_types Thrift API when an uneven number of levels across columns are read for Parquet files.
Fixes a crash that could occur in certain cases where Parquet files are imported from S3 with debug timers enabled.
Fixes a race condition that could occur with foreign table scheduled refreshes.
Fixes a crash that could occur when the ST_NPoints function is called with literal arguments.
Fixes a hang that could occur when a "clear CPU" or "clear GPU" request is made after the Executor Resource Manager returns an error response for a previous query.
Fixes an issue where certain sorted join query patterns could return wrong results.
Fixes an intermittent "Ran out of slots in the query output buffer" error that could occur due to incorrect reuse of the cardinality cache for similar queries.
Fixes a crash that could occur in certain cases where the null value results from the ST_Centroid function are passed in as arguments to other ST functions.
Fixes use cases where the Executor Resource Manager did not account for result set buffers that are allocated through the CPU buffer pool.
Fixes an issue where the use of the approx_count_distinct function could cause a slowdown for certain query patterns in distributed configurations.
Fixes an issue where wrong results could be returned due to an overflow when dividing two decimals.
Fixes a crash that could occur for certain query patterns with Common Table Expressions that project point columns.
Fixes a crash that could occur for queries that specify LIMIT clauses with floating point values.
Fixes a crash that could occur for certain cases where the output of an ST function is passed in as an argument to the ST_Contains function.
Fixes an issue where the ST_Distance function can return wrong results for cases where a polygon encloses another polygon.

Heavy Render - New Features and Improvements

Shader compiler optimizations.
Increased default res-gpu-mem value from 385Mb to 768Mb.

Heavy Render - Fixed Issues

Fixed shader compiler error when combining symbol rotation and accumulation.
Catch failed render result buffer allocations and throw an out of GPU memory error.
Fixed an issue that could cause a Cuda Error 700.
Fixes a crash that could occur for render requests containing certain sort query patterns.

Heavy Immerse - New Features and Improvements

Introducing the SQL Notebook in Immerse, which in addition to supporting a notebook view of query history, allows inline visualization of query results using bar charts, line charts, scatterplots, heatmaps, choropleths, and pointmaps. The SQL notebook also integrates directly with the HeavyIQ conversational analytics module, allowing you to ask questions of your data in natural language, returning visualizations, natural language answers, and tabular results along with the generated SQL. The new SQL notebook is off by default, but it can be enabled by setting "dev/enable_notebook_ui_sql_editor": true in the servers.json file.
Viridis, Turbo, and Plasma added as new color palettes.

Heavy Immerse - Fixed Issues

Fixes dropping of filter clauses from SQL on exiting dash panel edit mode.
Fixes cross-filtering on Number chart when filtering on a Vega Combo chart with a custom SQL base dimension.
Fixed regression for enabling feature flag “ui/enable_chart_filter_view".
Fixed dashboard loading error when switching tabs with a HeavyDB error present.
Fixed joined table referenced in a size measure on the Line Map chart.
Fixed issue with non-integer operands in modulo operation error for Contour chart.
Fixed issue with color range display of filtered values for the Contour chart.
Fixed code generation for order of evaluation in map charts using SAMPLE_RATIO.
Fixed issue with Pointmap rendering of filtered data.
Fixed various minor display and styling issue.

HeavyIQ Conversational Analytics

HeavyIQ Conversational Analytics allows users to ask questions of their data using natural language by leveraging a custom Large Language Model (LLM) that has been fine-tuned on over 60,000+ training pairs to provide state-of-the-art performance on text-to-sql and other data analytics tasks. HeavyIQ requires no external API calls and guarantees data privacy by virtue of being a fully offline model.
The primary interface point for the new HeavyIQ conversational analytics capabilities are via the new SQL editor (see above), but it can also be utilized via API if desired.

Release 7.x.x - Important Information

IMPORTANT - In HeavyDB Release 7.x.x, the “render groups” mechanism, part of the previous implementation of polygon rendering, has been removed. When you upgrade to HeavyDB Release 7.x.x, all existing tables that have a POLYGON or MULTIPOLYGON geo column are automatically migrated to remove a hidden column containing "render groups" metadata.

This operation is performed on all tables in all catalogs at first startup, and the results are recorded in the INFO log.

Once a table has been migrated in this manner, it is not backwards-compatible with earlier versions of HeavyDB. If you revert to an earlier version, the table may appear to have missing columns and behavior will be undefined. Attempting to query or render the POLYGON or MULTIPOLYGON data with the earlier version may fail or cause a server crash.

As always, HEAVY.AI strongly recommends that all databases be backed up, or at the very least, dumps are made of tables with POLYGON or MULTIPOLYGON columns using the existing HeavyDB version, before upgrading to HeavyDB Release 7.x.x.

Dumps of POLYGON and MULTIPOLYGON tables made with earlier versions can still be restored into HeavyDB Release 7.x.x. The superfluous metadata is automatically discarded. However, dumps of POLYGON and MULTIPOLYGON tables made with HeavyDB Release 7.x.x are not backwards-compatible with earlier versions.

This applies only to tables with POLYGON or MULTIPOLYGON columns. Tables that contain other geo column types (POINT, LINESTRING, etc.), or only non-geo column types, do not require migration and remain backwards-compatible with earlier relea

For Ubuntu installations, install libncurses5 with the following command:

sudo apt install libncurses5

Release 7.2.4 - March 20, 2024

HeavyDB - Fixed Issues

Adds a new option for enabling or disabling the use of virtual addressing when accessing an S3 compatible endpoint for import or HeavyConnect.
Improves logging related to system locks.

Heavy Immerse - Fixed Issues

Fixes issue with SAML authentication.

Release 7.2.3 - February 5, 2024

HeavyDB - New Features and Improvements

Improves performance of foreign tables that are backed by Parquet files in AWS S3.
Improves logging related to GPU memory allocations and data transfers.

HeavyDB - Fixed Issues

Fixes a crash that could occur for certain query patterns with intermediate geometry projections.
Fixes a crash that could occur for certain query patterns containing IN operators with string function operands.
Fixes a crash that could occur for equi join queries that use functions as operands.
Fixes an intermittent error that could occur in distributed configurations when executing count distinct queries.
Fixes an issue where certain query patterns with LIMIT and OFFSET clauses could return wrong results.
Fixes a crash that could occur for certain query patterns with left joins on Common Table Expressions.
Fixes a crash that could occur for certain queries with window functions containing repeated window frames.

Heavy Render - Fixed Issues

Fix several crashes that could occur during out-of-gpu memory error recovery

Heavy Immerse - Fixed Issues

Fixed dashboard load error when switching tabs.
Fixed table reference in size measure of a client-side join data source for linemap chart.
Fixed client-side join name reference.

Release 7.2.2 - December 15, 2023

HeavyDB - New Features and Improvements

Adds support for output/result set buffer allocations via the "cpu-buffer-mem-bytes" configured CPU memory buffer pool. This feature can be enabled using the "use-cpu-mem-pool-for-output-buffers" server configuration parameter.
Adds a "ndv-group-estimator-multiplier" server configuration parameter that determines how the number of unique groups are estimated for specific query patterns.
Adds "default-cpu-slab-size" and "default-gpu-slab-size" server configuration parameters that are used to determine the default slab allocation size. The default size was previously based on the "max-cpu-slab-size" and "max-gpu-slab-size" configuration parameters.
Improves memory utilization when querying the "dashboards" system table.
Improves memory utilization in certain cases where queries are retried on CPU.
Improves error messages that are returned for some unsupported correlated subquery use cases.

HeavyDB - Fixed Issues

Fixes an issue where allocations could go beyond the configured "cpu-buffer-mem-bytes" value when fetching table chunks.
Fixes a crash that could occur when executing concurrent sort queries.
Fixes a crash that could occur when invalid geometry literals are passed to ST functions.

Heavy Immerse - Fixed Issues

Fix for rendering a gauge chart using a parameterized source (join sources, custom sources).

Release 7.2.1 - December 4, 2023

HeavyDB - New Features and Improvements

Improves instrumentation around Parquet import and HeavyConnect.

HeavyDB - Fixed Issues

Fixes a crash that could occur for join queries that result in many bounding box overlaps.
Fixes a crash that could occur in certain cases for queries containing an IN operator with a subquery parameter.
Fixes an issue where the ST_POINTN function could return wrong results when called with negative indexes.
Fixes an issue where a hang could occur while parsing a complex query.

Heavy Render - Fixed Issues

Fixed error when setting render-mem-bytes greater than 4gb.

Heavy Immerse - Fixed Issues

Clamp contour interval size on the Contour Chart to prevent a modulo operation error.
Filter outlier values in the Contour Chart that skew color range.
Fixed sample ratio query ordering to address a pointmap rendering issue.
Fixed layer naming in the Hide Layer menu.

Release 7.2.0 - November 16, 2023

HeavyDB - New Features and Improvements

Adds support for URL_ENCODE, URL_DECODE, REGEXP_COUNT, and HASH string functions.
Enables log based system tables by default.
Adds support for log based system tables auto refresh behind a flag (Beta).
Improves the pre-flight query row count estimation process for projection queries without filters.
Improves the performance of the LIKE operator.

HeavyDB - Fixed Issues

General

Fixes errors that could occur when the REPLACE clause is applied to SQL DDL commands that do not support it.
Fixes an issue where the HeavyDB startup script could ignore command line arguments in certain cases.
Fixes a crash that could occur when requests were made to the detect_column_types API for Parquet files containing list columns.
Fixes a crash that could occur in heavysql when the \detect command is executed for Parquet files containing string list columns.
Fixes a crash that could occur when attempting to cast to text column types in SELECT queries.
Fixes a crash that could occur in certain cases where window functions were called with literal arguments.
Fixes a crash that could occur when executing the ENCODE_TEXT function on NULL values.
Fixes an issue where queries involving temporary tables could return wrong results due to incorrect cache invalidation.

Geo

Fixes an issue where the ST_Distance function could return wrong results when at least one of its arguments is NULL.
Fixes an issue where the ST_Point function could return wrong results when the "y" argument is NULL.
Fixes an issue where the ST_NPoints function could return wrong results for NULL geometries.
Fixes a crash that could occur when the ST_PointN function is called with out-of-bounds index values.
Fixes an issue where the ST_Intersects and ST_Contains functions could incorrectly result in loop joins based on table order.
Fixes an issue where the ST_Transform function could return wrong results for NULL geometries.
Fixes an error that could occur for tables with polygon columns created from the output of user-defined table functions.

Heavy Immerse - New Features and Improvements

[Beta] Geo Joins - Immerse now supports “contains” and “intersects” conditions for common geometry combinations when creating a join datasource in the no code join editor.
Join datasource crossfilter support: Charts that use single table data sources will now crossfilter and be crossfiltered by charts that use join data sources.
Layer Drawer - In layered map charts immerse now has a quick to access Layer Drawer, which allows for layer toggling, reordering, renaming, opacity, zoom visibility controls.
Zoom to filters - Map charts in immerse now support “zoom to filters” functionality, either on an individual chart layer (via the Layer Drawer) or on the whole chart.
Image support in map rollovers - URLs pointing to images will automatically be rendered as a scaled image, with clickthrough support to the full size image.

Heavy Immerse - Fixed Issues

Choropleth/Line Map join datasource support - Significantly improves performance in Choropleth and Line Map charts when using join data sources. Auto aggregates measures on geometry.
Fixes issue where sql editor will horizontally scroll with long query strings

Release 7.1.2 - October 4, 2023

HeavyDB - New Features and Improvements

Improves how memory is allocated for the APPROX_MEDIAN aggregate function.

HeavyDB - Fixed Issues

Fixes a crash that could occur when the DISTINCT qualifier is specified for aggregate functions that do not support the distinct operation.
Fixes an issue where wrong results could be returned for queries with window functions that return null values.
Fixes a crash that could occur in certain cases where queries have multiple aggregate functions.
Fixes a crash that could occur when tables are created with invalid options.
Fixes a potential data race that could occur when logging cache sizes.

Release 7.1.1 - September 15, 2023

HeavyDB - New Features and Improvements

Adds an EXPLAIN CALCITE DETAILED command that displays more details about referenced columns in the query plan.
Improved logging around system memory utilization for each query.
Adds an option to SQLImporter for disabling logging of connection strings.
Adds a "gpu-code-cache-max-size-in-bytes" server configuration parameter for limiting the amount of memory that can be used by the GPU code cache.
Improves column name representation in Parquet validation error messages.

HeavyDB - Fixed Issues

Fixes a parser error that could occur for queries containing a NOT ILIKE clause.
Fixes a multiplication overflow error that could occur when retrying queries on CPU.
Fixes an issue where table dumps do not preserve quoted column names.
Fixes a "cannot start a transaction within a transaction" error that could occur in certain cases.
Fixes a crash that could occur for certain query patterns involving division by COUNT aggregation functions.
Removes a warning that is displayed on server startup when HeavyIQ is not configured.
Removes spurious warnings for CURSOR type checks when there are both cursor and scalar overloads for a user-defined table function.

Heavy Render - New Features and Improvements

Adds hit testing support for custom measures that reference multiple tables.

Heavy Immerse - Fixed Issues

Fixes SAML authentication regression in 7.1.0
Fixes chart export regression in 7.1.0

Release 7.1.0 - August 22, 2023

HeavyDB - New Features and Improvements

Geospatial

Exposes new geo overlaps function ST_INTERSECTSBOX for very fast bounding box intersection detections.
Adds support for the max_reject COPY FROM option when importing raster files. This ensures that imports from large multi-file raster datasets continue after minor errors, but provides adjustable notification upon major ones.
Adds a new ST_AsBinary (also aliased as ST_AsWKB) function that returns the Well-Known Binary (WKB) representation of geometry values. This highly-efficient format is used by postGIS newer versions of Geopandas.
Adds a new ST_AsText (also aliased AS ST_AsWKT) function that returns the Well-Known Text (WKT) representation of geometry values. This is less efficient than WKB but compatible even with nonspatial databases.
Adds support for loading geometry values using the load_table_binary_arrow Thrift API.
New version of HeavyAI python library with direct Geopandas support.
New version of rbc-project with geo column support allowing extensions which input or output any geometric type.

Core SQL

New JAROWINKLER_SIMILARITY string operator for fuzzy matching between string columns and values. This is a case insensitive measure including edit transitions and (slightly) sensitive to white space.
New LEVENSHTEIN_DISTANCE string operator for fuzzy matching between string columns and values. This is case insensitive and represents the number of edits needed to make two strings identical. An “edit” is defined by either an insertion of a character, a deletion of a character, or a replacement of a character.
Extends the ALTER COLUMN TYPE command to support string dictionary encoding size reduction.
Improves the error message returned when out of bound values are inserted into FLOAT and DOUBLE columns.
Adds a "watchdog-max-projected-rows-per-device" server configuration parameter and query hint that determines the maximum number of rows that can be projected by each GPU and CPU device.
Adds a "preflight-count-query-threshold" server configuration parameter and query hint that determines the threshold at which the preflight count query optimization should be executed.
Optimizes memory utilization for projection queries on instances with multiple GPUs.

Predictive Modeling with HeavyML

Support for PCA models and PCA_PROJECT operator.
Support SHOW MODEL FEATURE DETAILS to show per-feature info for models, including regression coefficients and variable importance scores, if applicable.
Support for TRAIN_FRACTION option to specify proportion of the input data to a CREATE MODEL statement that should be trained on.
Support creation of models with only categorical predictors.
Enable categorical and numeric predictors to be specified in any order for CREATE MODEL statements and subsequent inference operations.
Enable Torch table functions (requires client to specify libtorch.so).
Add tf_torch_raster_object_detect for raster object detections (requires client to specify libtorch.so and provide trained model in torchscript format).

Extensions Framework

Allow Array literals as arguments to scalar UDFs
Support table function (UDTF) output row sizes up to 16 trillion rows
Adds support for Column<TextEncodingNone> and ColumnList<TextEncodingNone> table function inputs and outputs.

Performance Optimizations

SQL projections now are sized per GPU/CPU core instead of globally, meaning that projections are more memory efficient as a function of the number of GPUs/CPU threads used for a query. In particular, this means that various forms of in-situ rendering, for example, non-grouped pointmaps, renders can scale to N GPUs more points or use N GPUs less memory, depending on the configuration.
Better parallelize construction of metadata for subquery results for improved performance
Enables result set caching for queries with LIMIT clauses.
Enables the bounding box intersection optimization for certain spatial join operators and geometry types by default.

HeavyDB - Fixed Issues

Fix potential crash when concatenating strings with the output of a UDF.
Fixes an issue where deleted rows with malformed data can prevent ALTER COLUMN TYPE command execution.
Fixes an error that could occur when parsing odbcinst.ini configuration files containing only one installed driver entry.
Fixes a table data corruption issue that could occur when the server crashes multiple times while executing write queries.
Fixes a crash that could occur when attempting to do a union of a string dictionary encoded text column and a none encoded text column.
Fixes a crash that could occur when the output of a table function is used as an argument to the strtok_to_array function.
Fixes a crash that could occur for queries involving projections of both geometry columns and geometry function expressions.
Fixes an issue where wrong results could be returned when the output of the DATE_TRUNC function is used as an argument to the count distinct function.
Fixes an issue where an error occurs if the COUNT_IF function is used in an arithmetic expression.
Fixes a crash that could occur when the WIDTH_BUCKET function is called with decimal columns.
Fixes an issue where the WIDTH_BUCKET function could return wrong results when called with decimal values close to the upper and lower boundary values.
Fixes a crash that could occur for queries with redundant projection steps in the query plan.

Heavy Render - Fixed Issues

Fixes a crash that could occur on multi-gpu systems while handling an out of GPU memory error.

Heavy Immerse - New Features and Improvements

Zoom to filters, setting map bounding box to extent of current filter set.
Image preview in map chart popups where image URLs are present.

Heavy Immerse - Fixed Issues

Fixed error thrown by choropleth chart on polygon hover.

Release 7.0.2 - June 28, 2023

HeavyDB - New Features and Improvements

Adds support for nested window function expressions.
Adds support for exception propagation from table functions.

HeavyDB - Fixed Issues

Fixes a crash that could occur when accessing 8-bit or 16-bit string dictionary encoded text columns on ODBC backed foreign tables.
Fixes unexpected GPU execution and memory allocations that could occur when executing sort queries with the CPU mode query hint.
Fixes an issue that could occur when inserting empty strings for geometry columns.
Fixes an issue that could occur when out of bounds fragment sizes are specified on table creation.
Fixes an issue where system dashboards could contain unexpected cached data.
Fixes a crash that could occur when executing aggregate functions over the result of join operations on scalar subqueries.
Fixes a server hang that could occur when GPU code compilation errors occur for user-defined table functions.
Fixes a data race that could occur when logging query plan cache size.

Heavy Render - New Features and Improvements

Add support for rendering 1D “terrain” cross-section overlays.
Rewrite 2D cross-section mesh generation as a table function.
Further improvements to system state logging when a render out of memory error occurs, and move it to the ERROR log for guaranteed visibility.
Enable auto-clear-render-mem by default for any render-vega call taking < 10 seconds.

Heavy Render - Fixed Issues

Render requests with 0 width or height could lead to a CHECK failure in encodePNG. Invalid image sizes now throw a non-fatal error during vega parsing.

Heavy Immerse - New Features and Improvements

Visualize terrain at the base of atmospheric cross sections in the Cross Section chart with the new Base Terrain chart layer type.

Heavy Immerse - Fixed Issues

Fixed local timezone issue with Chart Animation using cross filter replay.

Release 7.0.1 - June 8, 2023

HeavyDB - New Features and Improvements

Improves instrumentation around CPU and GPU memory utilization and certain crash scenarios.

HeavyDB - Fixed Issues

Fixes a crash that could occur for GPU executed join queries on dictionary encoded text columns with NULL values.

Heavy Render - New Features and Improvements

Improve instrumentation and logging related to gpu memory utilization, particularly with polygon rendering, as well as command timeout issues

Heavy Render - Fixed Issues

Fix a potential segfault when a Vulkan device lost error occurs

Release 7.0.0 - May 1, 2023

HeavyDB - New Features and Improvements

IMPORTANT - In HeavyDB Release 7.0, the “render groups” mechanism, part of the previous implementation of polygon rendering, has been removed. When you upgrade to HeavyDB Release 7.0, all existing tables that have a POLYGON or MULTIPOLYGON geo column are automatically migrated to remove a hidden column containing "render groups" metadata.

This operation is performed on all tables in all catalogs at first startup, and the results are recorded in the INFO log.

Dumps of POLYGON and MULTIPOLYGON tables made with earlier versions can still be restored into HeavyDB Release 7.0. The superfluous metadata is automatically discarded. However, dumps of POLYGON and MULTIPOLYGON tables made with HeavyDB Release 7.0 are not backwards-compatible with earlier versions.

For Ubuntu installations, install libncurses5 with the following command:

sudo apt install libncurses5

Adds new Executor Resource Manager enabling parallel CPU and CPU-GPU query execution, and support for CPU execution on data inputs larger than fit in memory.
Adds HeavyML, a suite of machine learning capabilities accessible directly in SQL, including support for linear regression, random forest, gradient boosted trees, and decision tree regression models, and KMeans and DBScan clustering methods. (BETA)
Adds HeavyConnect support for MULTIPOINT and MULTILINESTRING columns.
Adds ALTER COLUMN TYPE support for text columns.
Adds a REASSIGN ALL OWNED command that allows for object ownership change across all databases.
Adds an option for validating POLYGON and MULTIPOLYGON columns when importing using the COPY FROM command or when using HeavyConnect.
Adds support for CONDITIONAL_CHANGE_EVENT window function.
Adds support for automatic casting of table function CURSOR arguments.
Adds support for Column<GeoMultiPolygon>, Column<GeoMultiLineString>, and Column<GeoMultiPoint> table function inputs and outputs.
Adds support for none encoded text column, geometry column, and array column projections from the right table in left join queries.
Adds support for literal text scalar subqueries.
Adds support for ST_X and ST_Y function output cast to text.
Improves concurrent execution of DDL and SHOW commands.
Improves error messaging for when the storage directory is missing.
Optimizes memory utilization for auto-vacuuming after delete queries.

HeavyDB - Fixed Issues

Fixes an issue where the root user could be deleted in certain cases.
Fixes an issue where staging directories for S3 import could remain when imports failed.
Fixes a crash that could occur when accessing the "tables" system table on instances containing tables with many columns.
Fixes a crash that could occur when accessing CSV and regex parsed file foreign tables that previously errored out during cache recovery.
Fixes an issue where dumping table foreign tables would produce an empty table.
Fixes an intermittent crash that could occur when accessing CSV and regex parsed file foreign tables that are backed by large files.
Fixes a "Ran out of slots in the query output buffer" exception that could occur when using stale cached cardinality values.
Fixes an issue where user defined table functions are erroneously categorized as ambiguous.
Fixes an error that could occur when a group by clause includes an alias that matches a column name.
Fixes a crash that could occur on GPUs with the Pascal architecture when executing join queries with case expression projections.
Fixes a crash that could occur when using the LAG_IN_FRAME window function.
Fixes a crash that could occur when projecting geospatial columns from the tf_raster_contour_polygons table function.
Fixes an issue that could occur when calling window functions on encoded date columns.
Fixes a crash that could occur when the coalesce function is called with geospatial or array columns.
Fixes a crash that could occur when projecting case expressions with geospatial or array columns.
Fixes a crash that could occur due to rounding error when using the WIDTH_BUCKET function.
Fixes a crash that could occur in certain cases where left join queries are executed on GPU.
Fixes a crash that could occur for queries with joins on encoded date columns.
Fixes a crash that could occur when using the SAMPLE function on a geospatial column.
Fixes a crash that could occur for table functions with cursor arguments that specify no field type.
Fixes an issue where automatic casting does not work correctly for table function calls with ColumnList input arguments.
Fixes an issue where table function argument types are not correctly inferred when arithmetic operations are applied.
Fixes an intermittent crash that could occur for join queries due to a race condition when changing hash table layouts.
Fixes an out of CPU memory error that could occur when executing a query with a count distinct function call on a high cardinality column.
Fixes a crash that could occur when running a HeavyDB instance in read-only mode after previously executing write queries on tables.
Fixes an issue where the auto-vacuuming process does not immediately evict chunks that were pulled in for vacuuming.
Fixes a crash that could occur in certain cases when HeavyConnect is used with Parquet files containing null string values.
Fixes potentially inaccurate calculation of vertical attenuation from antenna patterns in HeavyRF.

Heavy Render - New Features and Improvements

Add support for rendering a 1d cross-section as a line
Package the Vulkan loader libVulkan1 alongside heavydb

Heavy Render - Fixed Issues

Fix a device lost error that could occur with complex polygon renders

Heavy Immerse - New Features and Improvements

Data source Joins as a new custom data source type. (BETA)
Adds improved query performance defaults for the Contour Chart.
Adds access to new control panel to users with role "immerse_control_panel", even if the user is not a superuser.
Adds custom naming of map layers.
Adds custom map layer limit option using flag “ui/max_map_layers” which can be set explicitly (defaults to 8) or to -1 to remove the limit.

Heavy Immerse - Fixed Issues

Renames role from “immerse_trial_mode” to “immerse_export_disabled” and renames corresponding flag from “ui/enable_trial_mode” to “ui/user_export_disabled”.
Various minor UI fixes and polishing.
Fixes an issue where changing parameter value causes Choropleth popup to lose selected popup columns.
Fixes an issue where changing parameter value causes Pointmap to lose selected popup columns.
Fixes an issue where building a Skew-T chart results in a blank browser page.
Fixes an issue where Skew-T chart did not display wind barbs.
Fixes an issue with default date and time formatting.
Fixes an issue where setting flag "ui/enable_map_exports" to false unexpectedly disabled table chart export.
Fixes an issue with date filter presets.
Fixes an issue where filters "Does Not Contain" or "Does not equal" did not work on Crosslinked Columns.
Fixes an issue where charts were not redrawing to show the current bounding box filter set by the Linemap chart.

PreviousOverview NextSystem Requirements

Last updated 15 days ago