PA_CR_PA-3.7.0.0-752_impalad-1.3.0_simba_JDBC4-2.5.5.1007

Owned by Former user (Deleted)
Last updated: Jul 06, 2015 by Former user (Deleted)Version comment
5 min read

Preface

This report covers the following products.

  • Pentaho Analysis 5.1.0.0-752 ( 3.7.0.0-752 )
  • Impala impalad version cdh5-1.3.0 RELEASE
  • Simba driver for Impala JDBC4 2.5.5.1007

Feature

Status

Notes

Degenerate Schemas

 

Star Schemas


 

Snowflake Schemas

Not all join structures are properly handled. The JDBC parser fails to parse certain types of schemas.

Filters

Complex compound filters produce wrong numbers.

Top Count


 

Aggregation Tables


 

Null Values & Keys


 

Inline Tables


 

Distinct Count


Not all forms of distinct counts are supported, although the minimum support it offers is sufficient for Mondrian.

Grouping Sets


Grouping sets are not supported.

Failures

Complex filtering clauses cause wrong numbers to be returned

Symptom

When a complex compound predicate is used within a SQL query, the driver makes errors while parsing and the returned numbers are wrong.

Failed tests

Test

Result

org.pentaho.mondrian.tck.NativeFilterTest.testCompoundPredicate

Using a compound predicate like the one below produces wrong numbers. 

select sum(sales_fact_1997.unit_sales) as m0
  from store store
     , product product
     , sales_fact_1997 sales_fact_1997
 where sales_fact_1997.store_id  = store.store_id
   and sales_fact_1997.product_id = product.product_id
   and ((
           store.store_country     = 'USA'
       and store.first_opened_date = '1981-01-03'
       and store.last_remodel_date = TIMESTAMP '1991-03-13 00:00:00'
       )
    or (
         store.store_city          = 'San Diego'
     and store.store_state         = 'CA'
       )
    or (
         store.store_state         = 'WA'
     and store.store_sqft          > 50000
     and product.gross_weight      = 17.1
       )
    or (
         store.store_sqft is null
       )
    )



org.junit.ComparisonFailure: Row content doesn't match. expected:<[60,662]> but was:<[39,329]>
	at org.junit.Assert.assertEquals(Assert.java:115)
	at org.pentaho.mondrian.tck.SqlExpectation.validateRows(SqlExpectation.java:142)
	at org.pentaho.mondrian.tck.SqlExpectation.verify(SqlExpectation.java:64)
	at org.pentaho.mondrian.tck.SqlContext.verify(SqlContext.java:75)
	at org.pentaho.mondrian.tck.NativeFilterTest.testCompoundPredicate(NativeFilterTest.java:224)

org.pentaho.mondrian.tck.NativeFilterTest.testCompoundPredicateNoJoinsDateLiteralSyntax

Using a compound predicate like the one below produces wrong numbers. 

select sum(store.store_sqft) as m0
  from store store
 where (
           store.store_country     = 'USA'
       and store.first_opened_date = '1981-01-03'
       and store.last_remodel_date = TIMESTAMP '1991-03-13 00:00:00'
       )
    or (
         store.store_city        = 'San Diego'
     and store.store_state       = 'CA'
       )
    or (
         store.store_state       = 'WA'
     and store.store_sqft        > 30000
       )
    or ( store.store_sqft is null)


org.junit.ComparisonFailure: Row content doesn't match. expected:<1[27,510]> but was:<1[03822]>
	at org.junit.Assert.assertEquals(Assert.java:115)
	at org.pentaho.mondrian.tck.SqlExpectation.validateRows(SqlExpectation.java:142)
	at org.pentaho.mondrian.tck.SqlExpectation.verify(SqlExpectation.java:64)
	at org.pentaho.mondrian.tck.SqlContext.verify(SqlContext.java:75)
	at org.pentaho.mondrian.tck.NativeFilterTest.testCompoundPredicateNoJoinsDateLiteralSyntax(NativeFilterTest.java:230)

Support for database joins

Symptom

Not all forms of joins are supported by the database. This will prevent some types of schemas from being supported on the DB evaluated. In this case, the driver fails on implicit crossjoins, as well as complex snowflake schemas. This will impair Mondrian's capability to use snowflake schemas with this driver.

Failed tests

Test

Result

org.pentaho.mondrian.tck.JoinTest.testThreeWayJoinPlusDoubleStarLeaf89
org.pentaho.mondrian.tck.JoinTest.testThreeWayJoinPlusDoubleStarLeaf92

The driver throws an exception when the following arrangement of table is used. The error happens with both SQL-89 and SQL-92 style joins. 

D1'<--
      \
D1''<--D1<--      ----->D2
            \    /
             Fact
D3 <-------/



Caused by: java.sql.SQLException: [Simba][ImpalaJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: TStatus(statusCode:ERROR_STATUS, sqlState:HY000, errorMessage:AnalysisException: Unqualified column reference 'description' is ambiguous), Query: SELECT `warehouse_class`.`description`, `wc2`.`description`, `warehouse`.`warehouse_id`, `inventory_fact_1997`.`store_id`, `time_by_day`.`time_id`, `product`.`product_id` FROM `default`.`warehouse`, `default`.`inventory_fact_1997`, `default`.`product`, `default`.`time_by_day`, `default`.`warehouse_class`, `default`.`warehouse_class` `wc2` WHERE ((`wc2`.`warehouse_class_id` = `warehouse`.`warehouse_class_id`) AND ((`warehouse_class`.`warehouse_class_id` = `warehouse`.`warehouse_class_id`) AND ((`inventory_fact_1997`.`product_id` = `product`.`product_id`) AND ((`inventory_fact_1997`.`warehouse_id` = `warehouse`.`warehouse_id`) AND (`inventory_fact_1997`.`time_id` = `time_by_day`.`time_id`))))) ORDER BY `warehouse`.`warehouse_id` ASC, `inventory_fact_1997`.`store_id` ASC, `time_by_day`.`time_id` ASC, `product`.`product_id` ASC.
	at com.cloudera.impala.hivecommon.api.HS2Client.executeStatementInternal(HS2Client.java:832)
	at com.cloudera.impala.hivecommon.api.HS2Client.executeStatement(HS2Client.java:287)
	at com.cloudera.impala.hivecommon.dataengine.HiveJDBCNativeQueryExecutor.executeQuery(HiveJDBCNativeQueryExecutor.java:487)
	at com.cloudera.impala.hivecommon.dataengine.HiveJDBCDSIExtQueryExecutor.execute(HiveJDBCDSIExtQueryExecutor.java:165)
	at com.cloudera.impala.jdbc.common.SStatement.executeNoParams(SStatement.java:2695)
	at com.cloudera.impala.jdbc.common.SStatement.execute(SStatement.java:566)
	at org.pentaho.mondrian.tck.SqlExpectation$Builder$1.getData(SqlExpectation.java:269)
	at org.pentaho.mondrian.tck.SqlContext.verify(SqlContext.java:73)
	at org.pentaho.mondrian.tck.JoinTest.testThreeWayJoinPlusDoubleStarLeaf89(JoinTest.java:343)



Caused by: java.sql.SQLException: [Simba][ImpalaJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: TStatus(statusCode:ERROR_STATUS, sqlState:HY000, errorMessage:AnalysisException: Unqualified column reference 'description' is ambiguous), Query: SELECT `warehouse_class`.`description`, `wc2`.`description`, `warehouse`.`warehouse_id`, `inventory_fact_1997`.`store_id`, `time_by_day`.`time_id`, `product`.`product_id` FROM `default`.`inventory_fact_1997` INNER JOIN `default`.`warehouse` ON (`inventory_fact_1997`.`warehouse_id` = `warehouse`.`warehouse_id`) INNER JOIN `default`.`product` ON (`inventory_fact_1997`.`product_id` = `product`.`product_id`) INNER JOIN `default`.`time_by_day` ON (`inventory_fact_1997`.`time_id` = `time_by_day`.`time_id`) INNER JOIN `default`.`warehouse_class` ON (`warehouse_class`.`warehouse_class_id` = `warehouse`.`warehouse_class_id`) INNER JOIN `default`.`warehouse_class` `wc2` ON (`wc2`.`warehouse_class_id` = `warehouse`.`warehouse_class_id`) ORDER BY `warehouse`.`warehouse_id` ASC, `inventory_fact_1997`.`store_id` ASC, `time_by_day`.`time_id` ASC, `product`.`product_id` ASC.
	at com.cloudera.impala.hivecommon.api.HS2Client.executeStatementInternal(HS2Client.java:832)
	at com.cloudera.impala.hivecommon.api.HS2Client.executeStatement(HS2Client.java:287)
	at com.cloudera.impala.hivecommon.dataengine.HiveJDBCNativeQueryExecutor.executeQuery(HiveJDBCNativeQueryExecutor.java:487)
	at com.cloudera.impala.hivecommon.dataengine.HiveJDBCDSIExtQueryExecutor.execute(HiveJDBCDSIExtQueryExecutor.java:165)
	at com.cloudera.impala.jdbc.common.SStatement.executeNoParams(SStatement.java:2695)
	at com.cloudera.impala.jdbc.common.SStatement.execute(SStatement.java:566)
	at org.pentaho.mondrian.tck.SqlExpectation$Builder$1.getData(SqlExpectation.java:269)
	at org.pentaho.mondrian.tck.SqlContext.verify(SqlContext.java:73)
	at org.pentaho.mondrian.tck.JoinTest.testThreeWayJoinPlusDoubleStarLeaf92(JoinTest.java:381)

org.pentaho.mondrian.tck.JoinTest.testImplicitJoin

Implicit joins are not supported. If mondrian tries to evaluate a crossjoin of the members of two levels in a context allowing empty cells, the fact table is omitted from the SQL query and both tables are joined by what is called an 'implicit' join. 

Caused by: java.sql.SQLException: [Simba][ImpalaJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: TStatus(statusCode:ERROR_STATUS, sqlState:HY000, errorMessage:NotImplementedException: Join with 'default.warehouse_class' requires at least one conjunctive equality predicate. To perform a Cartesian product between two tables, use a CROSS JOIN.), Query: SELECT `warehouse`.`warehouse_id`, `warehouse_class`.`description` FROM `default`.`warehouse`, `default`.`warehouse_class`.
	at com.cloudera.impala.hivecommon.api.HS2Client.executeStatementInternal(HS2Client.java:832)
	at com.cloudera.impala.hivecommon.api.HS2Client.executeStatement(HS2Client.java:287)
	at com.cloudera.impala.hivecommon.dataengine.HiveJDBCNativeQueryExecutor.executeQuery(HiveJDBCNativeQueryExecutor.java:487)
	at com.cloudera.impala.hivecommon.dataengine.HiveJDBCDSIExtQueryExecutor.execute(HiveJDBCDSIExtQueryExecutor.java:165)
	at com.cloudera.impala.jdbc.common.SStatement.executeNoParams(SStatement.java:2695)
	at com.cloudera.impala.jdbc.common.SStatement.execute(SStatement.java:566)
	at org.pentaho.mondrian.tck.SqlExpectation$Builder$1.getData(SqlExpectation.java:269)
	at org.pentaho.mondrian.tck.SqlContext.verify(SqlContext.java:73)
	at org.pentaho.mondrian.tck.JoinTest.testImplicitJoin(JoinTest.java:120)

Warnings

Distinct Count

Symptom

Not all forms of distinct count queries are supported. One form of distinct count for multiple columns is supported however, so mondrian can batch the queries as needed. The integration tests have also shown that the dialect is issuing the distinct count queries correctly.

Failed tests

Test

Result

org.pentaho.mondrian.tck.AggregationTest.testDistinctTwoCount

Cannot batch multiple distinct count columns with the following syntax 

Caused by: java.sql.SQLException: [Simba][ImpalaJDBCDriver](500051) ERROR processing query/statement. Error Code: 0, SQL state: TStatus(statusCode:ERROR_STATUS, sqlState:HY000, errorMessage:AnalysisException: all DISTINCT aggregate functions need to have the same set of parameters as count(DISTINCT sales_fact_1997.unit_sales); deviating function: count(DISTINCT sales_fact_1997.store_id)), Query: SELECT COUNT(DISTINCT `sales_fact_1997`.`unit_sales`) as `count_sales`, COUNT(DISTINCT `sales_fact_1997`.`store_id`) as `count_store_id` FROM `default`.`sales_fact_1997`.
	at com.cloudera.impala.hivecommon.api.HS2Client.executeStatementInternal(HS2Client.java:832)
	at com.cloudera.impala.hivecommon.api.HS2Client.executeStatement(HS2Client.java:287)
	at com.cloudera.impala.hivecommon.dataengine.HiveJDBCNativeQueryExecutor.executeQuery(HiveJDBCNativeQueryExecutor.java:487)
	at com.cloudera.impala.hivecommon.dataengine.HiveJDBCDSIExtQueryExecutor.execute(HiveJDBCDSIExtQueryExecutor.java:165)
	at com.cloudera.impala.jdbc.common.SStatement.executeNoParams(SStatement.java:2695)
	at com.cloudera.impala.jdbc.common.SStatement.execute(SStatement.java:566)
	at org.pentaho.mondrian.tck.SqlExpectation$Builder$1.getData(SqlExpectation.java:269)
	at org.pentaho.mondrian.tck.SqlContext.verify(SqlContext.java:73)
	at org.pentaho.mondrian.tck.AggregationTest.testDistinctTwoCount(AggregationTest.java:200)

Grouping sets

Symptom

Queries which use grouping sets are not supported. This is a optimization feature supported by some more advanced databases. It allows to batch cell requests and improve the overall performance.

Failed tests

Test

Result

org.pentaho.mondrian.tck.GroupingSetTest.testEmptyEntry

Grouping set queries are not supported. 

select
    customer.gender as gender, sum(sales_fact_1997.store_cost) as sum_cost
from
    time_by_day, sales_fact_1997, customer
where
    (sales_fact_1997.time_id = time_by_day.time_id and time_by_day.the_year = 1997
    and sales_fact_1997.customer_id = customer.customer_id)
group by grouping sets
    ((customer.gender),())

org.pentaho.mondrian.tck.GroupingSetTest.testPlainEntry

Grouping set queries are not supported. 

select
    customer.gender as gender, sum(sales_fact_1997.store_cost) as sum_cost
from
    time_by_day, sales_fact_1997, customer
where
    (sales_fact_1997.time_id = time_by_day.time_id and time_by_day.the_year = 1997
    and sales_fact_1997.customer_id = customer.customer_id)
group by grouping sets
    ((customer.gender))

org.pentaho.mondrian.tck.GroupingSetTest.testComplexEntry

Grouping set queries are not supported. 

select
    time_by_day.the_year as the_year, customer.gender as gender, sum(sales_fact_1997.store_cost) as sum_cost
from
    time_by_day, sales_fact_1997, customer
where
    (sales_fact_1997.time_id = time_by_day.time_id and time_by_day.the_year = 1997
    and sales_fact_1997.customer_id = customer.customer_id)
group by grouping sets
    ((time_by_day.the_year, customer.gender))

org.pentaho.mondrian.tck.GroupingSetTest.testMultipleEntries

Grouping set queries are not supported. 

select
    time_by_day.the_year as the_year, customer.gender as gender, sum(sales_fact_1997.store_cost) as sum_cost
from
    time_by_day, sales_fact_1997, customer
where
    (sales_fact_1997.time_id = time_by_day.time_id and time_by_day.the_year = 1997
    and sales_fact_1997.customer_id = customer.customer_id)
group by grouping sets
    ((time_by_day.the_year, customer.gender), (time_by_day.the_year),())