Skip to main content

Adding an existing D3 Visualization

Using an Existing D3 Visualization

You can use the Visualization Builder tool to customize an existing D3 visualization and integrate it with MicroStrategy.

In this example, we describe how to customize a D3 Waterfall Chart, a publicly available visualization created by RSloan. You can get the code for this visualization from the public website, http://bl.ocks.org/rsloan/7123450, but to make the process as simple as possible, we have provided a zip file with the CSS, javascript and data files that are used by this visualization.

Once you have walked through the process of customizing the D3 Waterfall Chart, you can extrapolate from the instructions in this topic to customize other D3 visualizations.

  1. Install the Visualization Builder tool, if you have not already done so.
  2. Download the zip file that holds the CSS, javascript and data files used by the D3 Waterfall Chart visualization. Unzip the contents and save the following files in a location where they are easily accessible.

    • WaterfallChartJS.js
    • WaterfallCSS.css
    • data.csv
  3. Open MicroStrategy Web. In this example, use a Google Chrome browser because the instructions include ways to use Google Chrome Developer Tools to help understand and debug your visualization.
  4. Click the Visualization Builder link on the navigation pane to open the Visualization Builder tool.

    external image VisBuilderLink.png
  5. Click the Configuration tab.


    external image VisBuilder_ConfigTab.png


    1. For Visualization name, enter a descriptive name for the custom visualization you are building.

      external image VisBuilder_VisName.png
    2. Configure the required external libraries. You can get these from the D3 visualization code. One at a time, enter the URL for each library that you want to add in the text box at the bottom of the panel and click Add Library. In this example, you add the following D3 libraries:

      http://code.jquery.com/jquery-latest.js
      http://d3js.org/d3.v3.min.js

      external image VisBuilder_PropertiesTab_Libraries.png

    3. Click Apply.
  6. From the File menu, choose Save As.

    1. For Folder name, enter the name of the plug-in folder for your custom visualization. This is generally the same name as the visualization.

      external image VisBuilder_FolderName.png
    2. Click OK. The plug-in folder for the custom visualization you created is saved under your plugins folder.

      external image VisBuilder_FolderSaved.png
  7. Click OK.
  8. Close the Visualization Builder, and then re-open it.
  9. From the File menu, click Open. Select your custom visualization.

    external image VisBuilder_OpenVis.png

    1. The Code Editor tab should be open. Copy the code for the D3 visualization you are using. Paste the CSS for the style and the javascript code into the Code Editor tab. In this example, you copy and paste the contents of WaterfallCSS.css under Style , and you copy and paste the contents of WaterfallChartJS.js under Plot Code. Don't be concerned about the warnings.

      Note: While you are working on your visualization, the size and placement of the Style and Code sections on the Code Editor tab may vary, depending on factors such as whether Developer Tools are open, if you expanded a section, etc. In some cases, there is a large space between the Style and Code sections and you need to scroll down to see the code.

      external image VisBuilder_CodeEditorTab.png
    2. In the javascript code, find the D3 statement that adds the visualization to the body of the page. This is usually d3.select("body"). Replace it with d3.select(this.domNode).

      In this example, you change:
      var svg = d3.select("body").append("svg")

      to:
      var svg = d3.select(this.domNode).append("svg")
    3. Open the Google Chrome Developer Tools and disable caches by selecting Disable cache on the Network tab.

      external image DisableCache.png
    4. Click Apply in Visualization Builder.
    5. In the Google Chrome Developer Tools Console, an error will be displayed, saying that a resource was not found.

      external image DebuggerConsole.png

      This error is displayed in the Console because the code you pasted uses a data.csv file to load the data, and that file does not exist.

      external image CSVDataError.png
    6. Most D3 sample visualizations have an example of the data that is being used. In this case, the following data has been provided by the author.


      external image CSVData.png

    7. To have a better understanding of this visualization, add the data.csv file to the same folder in your plug-in where the javascript files are locatedā€”for example, ../plugins/MyCustomD3WaterfallChart/javascript/mojo/js/source/data.csv.

    8. After you add the data.csv file to the folder mentioned above, click Apply in the Visualization Builder again. The visualization should now display in the right panel.


      external image D3WaterfallChart.png

    9. You can use debugger to pause the execution of your code and inspect what is being done. This is a useful way to understand how the visualization gets and manipulates the data. Add debugger; after the data from data.csv has been retrieved.

      external image DebuggerCode.png
    10. Click Apply again. Notice that debugger stops the code execution.

      external image DebuggerConsole2.png
    11. On the Console tab, type "data" and press Enter. Expand each of the data objects on the console to see additional details about the data parameters that are being passed to the csv method.


      external image DebuggerConsole3.png


      This is a useful way to understand the format of the data. When data is retrieved from MicroStrategy using the API, the format might or might not be the same as the format expected by your visualization. Understanding this helps you to determine if you need to further manipulate the data in order for the visualization to work as expected with data coming from MicroStrategy.


      Remove debugger: from the code and save the file.

    12. Now you need to add your MicroStrategy data to your custom D3 visualization. You must do this before you add debugging code; otherwise, the code is deleted.

      1. To add data to the visualization in this example, you use an existing dataset in the MicroStrategy Tutorial project. You choose Select Existing Dataset, navigate to Shared Reports -> Subject Areas -> Customer Analysis -> Customers Summary, and click Select. If you are using an external dataset, you would choose Add External Data and import the data you are using.

        external image VisBuilder_Dataset.png
      2. Open the Editor tab.

        external image VisBuilder_EditorTab.png
      3. Drag the attributes and metrics you want to use for your visualization onto the Editor tab. In this example, you use:

        • Attribute: Month
        • Metrics: Customer CountCustomer Count ForecastLast Monthā€™s Customer Count
        external image VisBuilder_EditorTab_Data.png
    13. Now, you must replace the statement that pulls the sample data for the D3 visualization with a statement that pulls the data from MicroStrategy. In this example, the D3 visualization expects tabular data.

      Usually there are two types of data:

      • Tabular data

        • Typically represented by d3.csv("filename.csv",function(error,csv)){}
        • Since the visualization in this example expects tabular data, open the Code Editor and add:
          var csv = this.dataInterface.getRawData(mstrmojo.models.template.DataInterface.ENUM_RAW_DATA_FORMAT.ROWS_ADV);
          before:
          d3.csv("data.csv",function(error,csv)){}
      • Tree data

        • Typically represented by d3.json("filename.json",function(error,json)){}
        • If a visualization expects tree data, you would use::
          var json = this.dataInterface.getRawData(mstrmojo.models.template.DataInterface.ENUM_RAW_DATA_FORMAT.TREE);
      Note: In some cases, it is not simple to replace the csv method with the MicroStrategy API. For these cases, make sure that the data variable has the MicroStrategy data and not the data being retrieved from the CSV file.
    14. Add debugger under var csv = this.dataInterface.getRawData(mstrmojo.models.template.DataInterface.ENUM_RAW_DATA_FORMAT.ROWS_ADV);and click Apply again.

      Note: You must have added a dataset before adding the debugger code described above. If you add the debugger code first and then add a dataset, the code is deleted.

      external image DebuggerCode2.png
    15. You can use the Console to find the format of the data that is being retrieved from MicroStrategy as follows:


      When you clicked Apply, the execution is stopped by debugger after the data was retrieved from MicroStrategy:


      external image DebuggerConsole4.png


      On the Console tab, type "csv", and then press Enter. The MicroStrategy data objects are displayed.


      In this example, you will see that the data being retrieved from MicroStrategy has a different format from the data being used by the author of this visualization:


      Format of MicroStrategy data:


      external image DebuggerConsole5.png


      Format of visualization (D3 Waterall Chart) data:


      external image DebuggerConsole3.png


      The main difference is that the MicroStrategy data has an object with the metric value. The visualization data does not have an object for the metric.


      Remove debugger: from the code and save the file.

    16. You need to add additional logic to modify the MicroStrategy data so that it looks more like the data expected by the visualization. In this example, you add the following code after the line of code that pulls the MicroStrategy data:

      var gridData = this.dataInterface;
      var rowHeaders = gridData.getRowHeaders();
      var attributeName = rowHeaders.titles[0].n;
      for (var i = 0; i < csv.length; i++) {
      for (var key in csv[i]) {
      if (key !== attributeName) {
      csv[i][key] = csv[i][key]["rv"] + "";
      }
      }
      }

      If the object key does not match the attribute name, then you set that property to be the value of the metric. Note that the value of the metric in this visualization data is a string. That is why an empty string is being added to the value: csv[i][key] = csv[i][key]["rv"] + "";

  1. After you add the code with the additional logic, add debugger; after the new block of code to check how the data looks now.

    external image DebuggerConsole8.png

    Click Apply. When the execution stops, open the Console, and type "csv". The csv variables now look more like the data coming from data.csv.

    external image DebuggerConsole9.png

    Remove debugger: from the code and save the file.
  2. Now that the format of the data matches, you can replace the content of the data variable with the MicroStrategy data. After the code that gets the data, add data = csv;.


    external image DebuggerConsole10.png


    Now data refers to the variable you added earlier to pull MicroStrategy data:

    var csv = this.dataInterface.getRawData(mstrmojo.models.template.DataInterface.ENUM_RAW_DATA_FORMAT.ROWS_ADV);


    To confirm that the correct data is being retrieved, add debugger; after data=csv;and click Apply. When the processing stops, open the Console and type "data". The data should look like MicroStrategy data.


    external image DebuggerConsole9.png

    Remove debugger; and save your file. Stop and start the Visualization Builder.

  3. Many of the visualizations available on the Internet are created exclusively for the data the author references. In this example, the author uses the attribute called ā€œperiodā€, which is hard-coded in three places in the JavaScript code. You must replace all instances of the string "period" with the name of your attribute variable, attributeName.
    In the additional code you added, you get the attribute, called attributeName, by using:


    var gridData = this.dataInterface;
    var rowHeaders = gridData.getRowHeaders();
    var attributeName = rowHeaders.titles[0].n;

    In this example, you are using the attribute name. If you wanted to get the metric name, you would use the following line of code:


    var gridData = this.dataInterface;
    var metricName = gridData.getColHeaders(0).getHeader(0).getName();

    Note: Make sure to use the correct syntax. If you are trying to access the property of an object, you have to use square brackets so that the expression is evaluated first and then the value is gotten. For example, this doesnā€™t work:


    data[0].attributeName

    but this will return ā€œ2010ā€.


    data[0][attributeName]

    Make the following replacements:


    Replace
    return key !== "period";
    with
    return key !== attributeName;
    Replace:
    x0.domain(data.map(function(d) { return d.period; }));
    with
    x0.domain(data.map(function(d) { return d[attributeName]; }));

    Replace:
    return "translate(" + x0(d.period) + ",0)";
    with
    return "translate(" + x0(d[attributeName]) + ",0)";
  4. Finally, modify the width and height of the visualization so that the screen adjusts correctly. Typically, the width and height of visualizations are defined as fixed values. These must be replaced so that the sizes reflect the available space in MicroStrategy. For example:


    var margin = {top: 10, right: 10, bottom: 10, left: 10},
    width = parseInt(this.width,10) - margin.left - margin.right,
    height = parseInt(this.height,10) - margin.top - margin.bottom;
  5. Save your visualization and click Apply again. The Waterfall Chart should be displayed with your MicroStrategy data.

    external image WaterfallChart_MstrData.png

Comments

  1. Hi,
    Its really helpful, thank you so much for sharing this with brief explanation.
    Do we need to add any piece of code to make them use as selector ? or MicroStrategy API handle it by itself.

    Thanks
    Sunil



    ReplyDelete
  2. Excellent article for the people who need information about this course.
    Learn Data Science Online

    ReplyDelete
  3. If you are looking to download an MTD template, you may need to specify which specific type of template you are referring to. For example, if you are a VAT-registered business in the UK and you want to submit your VAT returns through MTD, you may need to MTD template download VAT template that is compatible with the software you are using.

    ReplyDelete

Post a Comment

Popular posts from this blog

MicroStrategy URL API Parameters

MicroStrategy URL Structure The following table summarizes the root URL structure used for every request to MicroStrategy Web. Environment Main Application URL Administration URL J2EE http://webserver/MicroStrategy/servlet/mstrWeb http://webserver/MicroStrategy/servlet/mstrWebAdmin .NET http://webserver/MicroStrategy/asp/Main.aspx http://webserver/MicroStrategy/asp/Admin.aspx Every request sent to MicroStrategy Web calls a central controller. Parameters are appended to  Main.aspx  or  mstrWeb  (in a .NET and J2EE environment, respectively) to indicate to the controller how the request should be internally forwarded and handled. The following examples show a URL for accessing a MicroStrategy folder when the user does not have an existing session. The URL contains not only the parameters needed to connect to MicroStrategy Web, but also the parameters needed to log on and create a session. J2EE environment: <a href="http:...

Microstrategy "Error type: Odbc error. Odbc operation attempted

 "Error type: Odbc error. Odbc operation attempted: SQLExecDirect. [HYT00:0: on SQLHANDLE] [MicroStrategy][ODBC Oracle Wire Protocol driver]Timeout expired" is shown when executing reports from Web When users are trying to execute some reports in MicroStrategy web in particular, they may receive the Error ā€œSQL Generation Complete Index out of rangeā€ and ā€œTimeout expiredā€ error as shown below: Possible Causes: One possible cause is that the MicroStrategy Intelligence Server using a cached database connection that was already dropped by the RDBMS. To resolve this: Admin should delete the database connection caches and create a new DSNs in case they are sharing DSNs to connect to different databases. In addition, change the settings for the ā€˜Connection lifetimeā€™ and the ā€˜Connection idle time outā€™.  Follow the steps below to perform the mentioned changes and verify the report after each step and some of the settings require i-server r...

Case functions Microstrategy

Ca se functions Microstrategy Case functions return specified data in a SQL query based on the evaluation of user-defined conditions. In general, a user specifies a list of conditions and corresponding return values. Case This function evaluates multiple expressions until a condition is determined to be true, then returns a corresponding value. If all conditions are false, a default value is returned.  Case  can be used for categorizing data based on multiple conditions. This is a single-value function. Syntax Case ( Condition1 ,  ReturnValue1 ,  Condition2 , ReturnValue2 ,...,  DefaultValue ) Example Case(([Total Revenue] < 300000), 0, ([Total Revenue] < 600000), 1, 2) sum(Case (Day@DESC in (ā€œSatā€,ā€Sunā€), Sales, 0) {~+} Sum(Case(Category@DESC In("Books","Electronics"),Revenue,0)){~+} CaseV (case vector) CaseV  evaluates a single metric and returns different values according to the results. It can be used to perfo...

Microstrategy Custom number formatting symbols

Custom number formatting symbols If none of the built-in number formats meet your needs, you can create your own custom format in the Number tab of the Format Cells dialog box. Select  Custom  as the Category and create the format using the number format symbols listed in the table below. Each custom format can have up to four optional sections, one each for: Positive numbers Negative numbers Zeros Text Each section is optional. Separate the sections by semicolons, as shown in the example below: #,###;(#,###);0;"Error: Entry must be numeric" For more examples, see  Custom number formatting examples . To jump to a section of the formatting symbol table, click one of the following: Numeric symbols Character/text symbols Date and time symbols Text color symbols Currency symbols Conditional symbols Numeric symbols For details on how numeric symbols apply to the Big Decimal data type, refer to the  Project Design Guide . ...

Microstrategy Dashboard performance improvements steps

Microstrategy  Dashboard performance improvements steps: Many times, causes of poor performance can be simplified to specific components. To troubleshoot performance issues, users must identify these components, then make the appropriate modifications to the environment and/or to the MicroStrategy dashboard to reduce bottlenecks. Dashboard execution stages can be represented below: MicroStrategy Intelligence Server When an end user makes a  Document Execution Request  through any client (a web browser via MicroStrategy Web, the MicroStrategy Desktop/Developer client, the MicroStrategy Mobile app, or the MicroStrategy Office client), the request is sent to the MicroStrategy Intelligence Server, which processes the request and prepares the response. The MicroStrategy Intelligence Server will execute all children datasets on the dashboard by either generating SQL and running this against the data warehouse, or by fetching data from a cache. The Inte...

Microstrategy Authentication Using the URL API

Microstrategy Authentication Using the URL API Users have to be authenticated before accessing functionality in MicroStrategy Web. Using the URL API, there are three ways for MicroStrategy Web to obtain the information needed to authenticate a user. Opening the login page to gather user for credentials    Bypassing the login page by providing credentials in the URL    Bypassing the login page by providing the session state in the URL A detailed explanation of each method for obtaining the authentication information is provided below. Opening the login page to gather user for credentials If the URL attempts to access a MicroStrategy Web page that requires login and no credentials or session state are provided in the URL, the user is redirected to the login page. If login is successful, the user is redirected to the specified page.   The sample URL shown below executes a report without providing authenticating information. Since the Repo...

Microstrategy Dossiers explained

Microstrategy  Dossiers With the release of MicroStrategy 10.9, weā€™ve taken a leap forward in our dashboarding capabilities by simplifying the user experience, adding storytelling, and collaboration.MSTR has  evolved dashboards to the point that they are more than dashboards - they are  interactive, collaborative analytic stories . Ultimately, it was time to go beyond dashboards, both in concept and in name, and so  the've  renamed VI dashboards to  ā€˜ dossiers ā€™.  Dossiers can be created by using the new Desktop product or Workstation or simply from the Web interface which replaces Visual Insights. All the existing visual Insights dashboards will be converted to Dossiers   With MicroStrategy 10.9, there was an active focus on making it easier to build dashboards for the widest audience of end users. To achieve this, some key new capabilities were added that make it easier to author, read, interact and collaborate on dashboards ...

Multi-Table Data Import(MTDI) from one or more supported data sources

Multi-Table Data Import(MTDI) from one or more supported data sources In MicroStrategy Analytics Enterprise Web 10 onewards, users can now simultaneously import two or more tables from one or more supported data sources, this feature is called Multi-Table Data Import (MTDI) which has been renamed as Super Cubes in MSTR 2019 (Does it sound like multisourcing for all the users without admin help?) Currently, all connectors in MicroStrategy Web 10 except " OLAP " and " Search Engine Indices " support Multi-Table Data Import. Users are able to add multiple tables/files when doing data import from single connector, as shown below: Users are also able to combine multiple tables/files from different sources and store them into one single Intelligent Cube, as shown below:

Remove the "Layout" tab in a Document in MicroStrategy

Remove the "Layout" tab in a Report Services Document in MicroStrategy In MicroStrategy Web 10.x, when using report services documents, there is a 'Layout' tab on top of the document even when there is only one layout in document, as shown below: ACTION: To remove the tab from being visible, follow these steps: Go to design mode for the document where the 'Layout' tab is no longer desired and under the 'Tools' tab, select the 'Document Properties' option:   A new window will open. Select the 'Advanced' section under 'Document Properties' on the left pane, and make sure to uncheck the option for 'Show single layout tab' under the 'Layout' section as shown below:   Once the option is unchecked, click on the 'Apply' button. The user will now notice that the 'Layout' tab has been removed from view in all document modes:  Note: This option is set on an individual document level.  ...

Prompt-in-prompt(Nested Prompts) in Microstrategy

Prompt-in-prompt(Nested Prompts) in  Microstrategy Nested prompts allows you to create one prompt based on the other and other bases on another, nested prompts allows us to prompt the highest level(Like year) to middle level(like Quarter, then to the low level(like Month). Here you can see how to  create a 3-level deep nested prompt that will prompt the user to select a year, then a quarter within that year, then a month within that quarter. Prompt-in-prompt is a feature in which the answer to one prompt is used to define another prompt. This feature is only implemented for element list prompts . The following procedure describes how to achieve this: Create the highest level filter. This is a filter which contains a prompt on an attribute element list. Create a filter on the attribute "Year." Click "prompt on attribute element list" and click "Next" through the rest of the screens to accept the default values. Do not set any additio...