Skip to main content

Optimizing queries in Microstrategy using VLDB properties

Optimizing queries in  Microstrategy using VLDB properties

#vldb #vldbproperties

The table below summarizes the Query Optimizations VLDB properties. Additional details about each property, including examples where necessary, are provided in the sections following the table.

Property Description Possible Values Default Value
Determines whether the Engine calculates an aggregation function and a join in a single pass or in separate passes in the SQL.
(default) Final pass CAN do aggregation and join lookup tables in one pass
One additional final pass only to join lookup tables
Final pass CAN do aggregation and join lookup tables in one pass
Indicates during which pass the report filter is applied.
Apply filter only to passes touching warehouse tables
Apply filter to passes touching warehouse tables and last join pass, if it does a downward join from the temp table level to the template level
Apply filter to passes touching warehouse tables and last join pass
Apply filter only to passes touching warehouse tables
Controls how the total number of rows are calculated for incremental fetch.
Use Count(Attribute@ID) to calculate total element number (uses count distinct if necessary)
Use ODBC cursor to calculate total element number
Use Count(Attribute@ID) to calculate total element number (uses count distinct if necessary)
For Tandem databases, the default is Use ODBC Cursor.
Determines how distinct counts of values are retrieved from partitioned tables.
Do not select distinct elements for each partition
Select distinct elements for each partition
Do not select distinct elements for each partition
Helps optimize custom group banding when using the Count Banding method. You can choose to use the standard method that uses the Analytical Engine or database-specific syntax, or you can choose to use case statements or temp tables.
Treat banding as normal calculation
Use standard case statement syntax
Insert band range to database and join with metric value
Treat banding as normal calculation
Helps optimize custom group banding when using the Points Banding method. You can choose to use the standard method that uses the Analytical Engine or database-specific syntax, or you can choose to use case statements or temp tables.
Treat banding as normal calculation
Use standard case statement syntax
Insert band range to database and join with metric value
Treat banding as normal calculation
Helps optimize custom group banding when using the Size Banding method. You can choose to use the standard method that uses the Analytical Engine or database-specific syntax, or you can choose to use case statements or temp tables.
Treat banding as normal calculation
Use standard case statement syntax
Insert band range to database and join with metric value
Treat banding as normal calculation
Defines if and how Intelligent Cube data is normalized to save memory resources.
Do not normalize Intelligent Cube data
Normalize Intelligent Cube data in Intelligence Server
Normalize Intelligent Cube data in database using Intermediate Table Type
Normalize Intelligent Cube data in database using Fallback Type
Normalize Intelligent Cube data basing on dimensions with attribute lookup filtering
Normalize Intelligent Cube data basing on dimensions with no attribute lookup filtering
Normalize Intelligent Cube data in Intelligence Server
Defines if and how report data is normalized to save memory resources.
Do not normalize report data
Normalize report data in Intelligence Server
Normalize report data in database using Intermediate Table Type
Normalize report data in database using Fallback Table Type
Normalize report data basing on dimensions with attribute lookup filtering
Do not normalize report data
Determines whether the sort order of attribute elements on reports considers special sort order formatting defined for attributes.
Sort attribute elements based on the attribute ID form for each attribute
Sort attribute elements based on the defined 'Report Sort' setting of all attribute forms for each attribute
Sort attribute elements based on the attribute ID form for each attribute
Determines level (dimension) replacement for non parent-child related attributes in the same hierarchy.
Use relational model
Use dimensional model
Use relational model
Enable or disable the Analytical Engine's ability to treat attributes defined on the same column with the same expression as attribute roles.
Enable Engine Attribute Role feature
Disable Engine Attribute Role feature
Disable Engine Attribute Role feature
Determines if metric qualifications that are included in separate passes of SQL are included in a single pass of SQL when possible.
Enable Filter tree optimization for metric qualifications
Disable Filter tree optimization for metric qualifications
Enable Filter tree optimization for metric qualifications
Determines whether data that is transferred between Intelligence Server and a database is performed using a single transfer of data or multiple, incremental transfers of data
Enable Incremental Data Transfer
Disable Incremental Data Transfer
Disable Incremental Data Transfer
Determines how many queries can be executed in parallel as part of parallel query execution support
User-defined
2
Allows you to choose how to handle prequerying the metadata partition.
Use count(*) in prequery
Use constant in prequery
Use count(*) in prequery
Defines which technique to use to support multiple data sources in a project.
Use MultiSource Option to access multiple data sources
Use database gateway support to access multiple data sources
Use MultiSource Option to access multiple data source
Defines whether OLAP functions support backwards compatibility or reflect enhancements to OLAP function logic.
Preserve backwards compatibility with 8.1.x and earlier
Recommended with 9.0 and later
Preserve backwards compatibility with 8.1.x and earlier
Determines whether MicroStrategy attempts to execute multiple queries in parallel to return report results faster and publish Intelligent Cubes.
Disable parallel query execution
Enable parallel query execution for multiple data source reports only
Enable parallel query execution for all reports that support it
Disable parallel query execution
Determines whether reports and Intelligent Cubes include an estimate in the percent of processing time that would be saved if parallel Query execution was used to run multiple queries in parallel.
Disable parallel query execution improvement estimate in SQL view
Enable parallel query execution improvement estimate in SQL view
Disable parallel query execution improvement estimate in SQL view
Determines how calculation ranking is performed.
Use ODBC ranking (MSTR 6 method)
Analytical engine performs rank
Use ODBC ranking (MSTR 6 method).
Determines whether to keep or remove aggregations in SQL queries executed from MicroStrategy.
Remove aggregation according to key of FROM clause
Remove aggregation according to key of fact tables (old behavior)
Remove aggregation according to key of FROM clause
Determines whether Group By and aggregations are used for attributes with the same primary key.
Remove aggregation and Group By when Select level is identical to From level
Remove aggregation and Group By when Select level contains all attribute(s) in From level
Remove aggregation and Group By when Select level is identical to From level
Determines whether an optimization for outer join processing is enabled or disabled.
Disable optimization to remove repeated tables in full outer join and left outer join passes
Enable optimization to remove repeated tables in full outer join and left outer join passes
Enable optimization to remove repeated tables in full outer join and left outer join passes
Allows you to use set operators in sub queries to combine multiple filter qualifications. Set operators are only supported by certain database platforms and with certain sub query types.
Disable Set Operator Optimization
Enable Set Operator Optimization (if supported by database and [Sub Query Type])
Disable Set Operator Optimization
Determines the level by which SQL queries in reports are optimized.
Level 0: No optimization
Level 1: Remove Unused and Duplicate Passes
Level 2: Level 1 + Merge Passes with Different SELECT
Level 3: Level 2 + Merge Passes, which only hit DB Tables, with different WHERE
Level 4: Level 2 + Merge All Passes with Different WHERE
Level 4: Level 2 + Merge All Passes with Different WHERE
Allows you to determine the type of subquery used in engine-generated SQL.
WHERE EXISTS (SELECT * ...)
WHERE EXISTS (SELECT col1, col2...)
WHERE COL1 IN (SELECT s1.COL1...) falling back to EXISTS (SELECT * ...) for multiple columns IN
WHERE (COL1, COL2...) IN (SELECT s1.COL1, s1.COL2...)
Use Temporary Table, falling back to EXISTS (SELECT *...) for correlated subquery
WHERE COL1 IN (SELECT s1.COL1...) falling back to EXISTS (SELECT col1, col2 ...) for multiple columns IN
Use Temporary Table, falling back to IN (SELECT COL) for correlated subquery
Use Temporary Table, falling back to EXISTS (SELECT *...) for correlated subquery
Defines whether to attempt to improve performance of reports that use expression-based transformations.
Always join with transformation table to perform transformation
Use transformation formula instead of join with transformation table when possible
Use transformation formula instead of join with transformation table when possible
Determines whether the Analytical Engine should keep or remove the unrelated filter.
Remove unrelated filter
Keep unrelated filter
Keep unrelated filter and put condition from unrelated attributes in one subquery group
Remove unrelated filter
Determines whether the Analytical Engine should keep or remove the unrelated filters when using nested metrics.
Use the 8.1.x behavior:
Use the 9.0.x behavior:
Use the 8.1.x behavior
Determines the table used for qualifications in the WHERE clause.
Use lookup table
Use fact table
Use fact table







Comments

Popular posts from this blog

Types of prompts in Microstrategy

Types of prompts in Microstrategy The different types of prompts allow you to create a  prompt  for nearly every part of a report. Prompts can be used in many objects including reports, filters, metrics, and custom groups, but all prompts require user interaction when the report is executed. The correct prompt type to create depends on what report objects you want users to be able to base a filter on to filter data, as described in the list below. Filter definition prompts   allow users to determine how the report's data is filtered, based on one of the following objects: Attributes in a hierarchy : Users can select prompt answers from one or more attribute elements from one or more attributes. The attribute elements that they select are used to filter data displayed on the report. This prompt lets you give users the largest number of attribute elements to choose from when they answer the prompt to define their filtering criteria. For example, on a repor...

Microstrategy "Error type: Odbc error. Odbc operation attempted

 "Error type: Odbc error. Odbc operation attempted: SQLExecDirect. [HYT00:0: on SQLHANDLE] [MicroStrategy][ODBC Oracle Wire Protocol driver]Timeout expired" is shown when executing reports from Web When users are trying to execute some reports in MicroStrategy web in particular, they may receive the Error “SQL Generation Complete Index out of range” and “Timeout expired” error as shown below: Possible Causes: One possible cause is that the MicroStrategy Intelligence Server using a cached database connection that was already dropped by the RDBMS. To resolve this: Admin should delete the database connection caches and create a new DSNs in case they are sharing DSNs to connect to different databases. In addition, change the settings for the ‘Connection lifetime’ and the ‘Connection idle time out’.  Follow the steps below to perform the mentioned changes and verify the report after each step and some of the settings require i-server r...

Create an alert-based subscription in MicroStrategy Distribution Services

Create an alert-based subscription in MicroStrategy Distribution Services on Web Subscription to a report or Report Services document which will be executed when a certain conditional threshold is met based on another executing report. For example, a scheduled report executes which shows the Revenue by day for the past week. If the Revenue on any one day falls below a certain value, a subscription to another report or Report Services document can be triggered and delivered to a recipient. An alert based subscription can only be created directly on a report; however, another report or Report Services document can be delivered when the alert based subscription is triggered. Note: you need a grid report to create an alert and you cannot create if you want to create on a document with text boxes. The following example will walk through the basic steps on how to setup a subscription based on an alert like this: Follow the brief  steps bel...

Settings for Outer Join between metrics in MicroStrategy

Settings for Outer Join between metrics in MicroStrategy MicroStrategy adopts multi-pass logic to determine the execution plan for a report. This means that every metric is evaluated in separate SQL passes. Outer Joins come into play when MicroStrategy Engine merges the results from all SQL passes into one report. For a multi-pass report, different Outer Join behaviors can give the user completely different results. In addition, report metrics can be of different types which can, in some cases, influence the result of the outer join. In MicroStrategy, there are two settings that users can access to control Outer Join behavior : Formula Join Type and Metric Join Type . Metric Join Type: VLDB Setting at Database Instance Level Report and Template Levels Report Editor > Data > Report Data Options Metric Level   Metric editor > Tools > Metric Join Type Control Join between Metrics Formula Join Type: Only at Compound/Split...

Customers Who Live in the Same City as Call Centers

Customers Who Live in the Same City as Call Centers Your new utility company has call centers located throughout the country, and your recent surveys indicate that customers who live in the same city as a call center are particularly satisfied with service due to extremely rapid repairs during power outages. To begin your new advertising campaign, you want to generate a list of Call Centers that coincide with Customer Cities. The following steps create an attribute-to-attribute qualification filter that generates the list of desired cities. To Create an Attribute-To-Attribute Qualification that Compares the Call Center and Customer City Attributes In MicroStrategy Web, log in to a project. Open any folder page (for example, click Shared Folders on the home page). Click the  Create Filter  icon  . From the Object browser on the left, select the  Customer City  attribute from the Customers hierarchy and drag it to the filter pane on the right. Change  Qualify...

MicroStrategy Hadoop Gateway operation modes

MicroStrategy Hadoop Gateway operation modes MicroStrategy Hadoop Gateway is a native connector which was built based on Spark 1.6.x. You can choose one or more data files from Hadoop HDFS and load them into MicroStrategy Intelligence Server. Data files can be published as either an In-Memory Cube or a Live Connect Cube. MicroStrategy Hadoop Gateway supports three operation modes : YARN client Standalone (HDP cluster does not support Standalone) Local YARN client mode: The driver runs in the client process, and the application master is only used for requesting resources from YARN. Running in this mode requires YARN service to be enabled on your Hadoop cluster. Standalone mode:  MicroStrategy Hadoop Gateway uses Spark Master to coordinate data processing. Local mode:  no application is deployed in the Spark nodes. All data processing is executed in the MicroStrategy Hadoop Gateway host. This modality is intended for testing and troubleshooting.

Algorithm to calculate Logical Table Size in Microstrategy

How are the fact tables determined using the logical table size for SQL generation in MicroStrategy The logical table size is an integer number that represents the granularity or level of aggregation of a particular table. It is called 'logical' because it is not related to the physical size of the tables (number of rows). It is calculated according to the attribute IDs that are present in the table and their level in the system hierarchy.   Even though, the number does not reveal the actual number of rows in the table, it is an accurate way of measuring a table size without having to access its contents.   IMPORTANT:   The system hierarchy is defined by the parent-child relationships between attributes of the same family (formerly known as a dimension), not by user-defined hierarchies (i.e., drilling hierarchies).   MicroStrategy Engine utilizes an algorithm based on attribute keys to calculate the Logical Table Size (LTS): Given the following tables: ...

Metadata Doctor (MD Doctor) in Microstrategy

Metadata Doctor (MD Doctor) in Microstrategy Metadata Doctor (MD Doctor) is a utility that detects and fixes certain physical inconsistencies in MicroStrategy 9.4.x - 9.5.x metadatas that may prevent MicroStrategy 9.4.x - 9.5.x products from functioning correctly.  In simple terms, it detects physical inconsistencies by running SQL against different metadata tables and then comparing results.  If an entry is found in one table but not in the main lookup table of the metadata then that denotes a physical inconsistency and MD Doctor will  delete  that orphan entry.  Note:  MD Doctor is not a supported tool for MicroStrategy 10.x metadatas. NOTE:   MD Doctor should be used only after a metadata backup has been taken.  MD Doctor should not be used repeatedly.  It is meant to primarily serve as a quick-fix to physical inconsistencies and get environments up and running.  If repeated use of MD Doctor is needed then ...

Microstrategy Removing sections that do not have metric data

Removing sections that do not have metric data This is an interesting feature which might not be explored by many of us and it comes us handy. A  cross join between datasets can result in rows or Group Header/Footer sections that do not have metric data. For example, a document contains two datasets. Dataset 1 contains Year and Revenue, with data for three years (2007-2009). Dataset 2 contains Year and Profit, filtered to return data for only two years (2008 and 2009). If you place Year and Profit in the Details and execute the document, it displays three rows, although no profit data exists for 2007. This is a product of the cross join between the two datasets. You do not want to see the blank line for 2007 since it does not give you any data for profit. You can select the  Trim sections for which no metric value data is available  check box. This removes the row for 2007, since no metric data for Profit is available for 2007. The results are shown below: ...

Microstrategy Custom number formatting symbols

Custom number formatting symbols If none of the built-in number formats meet your needs, you can create your own custom format in the Number tab of the Format Cells dialog box. Select  Custom  as the Category and create the format using the number format symbols listed in the table below. Each custom format can have up to four optional sections, one each for: Positive numbers Negative numbers Zeros Text Each section is optional. Separate the sections by semicolons, as shown in the example below: #,###;(#,###);0;"Error: Entry must be numeric" For more examples, see  Custom number formatting examples . To jump to a section of the formatting symbol table, click one of the following: Numeric symbols Character/text symbols Date and time symbols Text color symbols Currency symbols Conditional symbols Numeric symbols For details on how numeric symbols apply to the Big Decimal data type, refer to the  Project Design Guide . ...