Sunday 6 January 2013

OBIEE11g : Export to Excel issue

Hi All,

We have gone through a strange issue in the recent project with an export option. As we have huge amount of data on the reports which are retuning about more than 1,00,000 records, OBIEE is creating the excel files which has a size of 200 MB to 2GB. But the clients are more interested to do their analysis in excel only. As a work around we suggested to use export to CSV. This is working fine but catch up with another issue with descriptive data which has commas (,) in it. If we have any , in the column data the CSV is considering it as new column hence we are getting difference in row count and the formatting also. Again there is a workaround for this CSV issue which is nothing but replacing (,) with any other special character which is not serving the purpose. So we did not have any other option other than making the Export to Excel works as per the expectations. Our expectations are as follows...

1) Export to Excel should create the small files which ranges to KB to MB.
2) We should not miss any data or columns on exporting ( This also one known bug in OBIEE 11g all the versions)
3) The formatting should be proper which matches with the report.


Solution:

To solve this issue we have taken the help from Oracle support by creating an P1 Service Request. Even though its not a permanent solution its serving the requirements for now. Oracle said they are going to provide the permanent solution in the future version which is 11.1.1.7.0 ( Its going to be a bundle patch mostly). The solution is as follows...

1)      Go to the following path to edit controlmessages.xml file 
/<OBIEE_HOME>/Oracle_BI1/bifoundation/web/msgdb/messages
           Fix: do the following changes
          Change export "format=mht" to "format=excel"
Note: Replace the text  “mht” to “excel” . Don’t forget to take the back up for the controlmessages.xml file before editing.
Don’t place the back up in the same folder, save the back up in a different folder.

2)      Go to the following path to edit config.xml file 
<OBIEE_HOME>/instances/instance1/config/OracleBIJavaHostComponent/coreapplication_obijh1
Fix: do the following changes

Before:

<XMLP>
      <InputStreamLimitInKB>8192</InputStreamLimitInKB>
      <ReadRequestBeforeProcessing>true</ReadRequestBeforeProcessing>
   </XMLP>

<DVT>
      <InputStreamLimitInKB>8192</InputStreamLimitInKB>
</DVT>

After:

<XMLP>
      <InputStreamLimitInKB>0</InputStreamLimitInKB>
      <ReadRequestBeforeProcessing>true</ReadRequestBeforeProcessing>
</XMLP>

<DVT>
      <InputStreamLimitInKB>0</InputStreamLimitInKB>
</DVT>

Note: 0 represents unlimited. No Need to restart the services.

Result: Exporting to excel in OBIEE report is creating huge file size. Before fix for 5000 records the file size was 1.6 MB and after fix the file size was 800KB

 Hope this helps you......  :)

25 comments:

  1. I am having an issue in exporting a huge amount of data in OBIEE 11g, what happens is : I am able to export the Whole table data which is around 6000 Records, but when I open Excel Sheet the Alignment of the report is ruined after Record number 1890.

    I tried this from different browsers and the same result appeared.

    can anyone help me with that ?

    ReplyDelete
  2. I did all step, but isn't working... OBIEE 11.1.1.6.0

    ReplyDelete
  3. I see two scenarios here, one is the sheer volume and the other is the formatting. CSVs are always better on volume. But it does do wiered things to the formatting.

    In Informatica, you could delete the CR LF character, which are the ones that skew the cells and skip a fe lines, you can use the below:

    REPLACECHR(0, COMMENTS_LONG, chr(10) || chr(13) || chr(28), ' ')

    ReplyDelete
  4. This comment has been removed by the author.

    ReplyDelete
  5. Ad. 1
    We have to change export "format=mht" to "format=excel" in tag WebMessage name="kuiIQYContent" ?
    In my case there already is Format=excel...
    And files are still large...

    ReplyDelete
    Replies
    1. Hi Robert,

      As you mentioned it is not working all the times.This work around is not working as per the expectation. Oracle has come up with the new version 7.0 which has resolved this issue.Please check the following link.

      http://obieeil.blogspot.co.il/2013/04/obiee-11117-new-features.html?goback=%2Egde_47239_member_228804501

      Thanks,
      Nagarjuna

      Delete
  6. Hi,

    I have a question!
    Can we make multiple rows into a single row.

    How can i Make Multiple Rows into a single Row in OBIEE 11g
    e.g

    31-45 days x y z
    45-60 days a b c
    61+ days p q r

    Now, I want to make these 3 rows under 1 row and display as
    >30 days x+a+p y+b+q z+c+r

    How can we achieve this??

    Your help is highly Appreciated.
    Thanks,
    Shilpa

    ReplyDelete
  7. Hi Shilpa,

    Please go through the below links....

    http://oraclebizint.wordpress.com/2008/02/12/oracle-bi-ee-101332-pivoting-strings-converting-rows-into-columns/

    http://obiee101.blogspot.com/2008/08/obiee-children-of-level-converting-rows.html

    Thanks,
    Nagarjuna

    ReplyDelete
  8. Thank You very much Dinesh for filling me with lots of Positive energy......... :)

    ReplyDelete
  9. Hey Venkat.. I tried dis one

    It working fine for me. Really your blog gives very clear solution..

    thank for posting real time work

    Regards
    Rakesh Patil

    ReplyDelete
  10. Hi everyone, I am a Oracle BI 11g power user, but not an IT expert. We use BI agent/Ibots to send large excel reports ranging from 60-100 MB in file size which causes delivery issues due to file size restrictions in our mail server system.

    I believe the large file size issue is that the report title "merges multiple cells" causing enormous file sizes. When I unmerge the all the cells in Excel and resave, the file size goes from 100MB to less than 2 MB.

    Is there a way to "turn off" the cell merging on report sent via BI Agents/Ibots via additional coding in Oracle 11g?

    Thanks for any advice!!

    Jon Haggert

    ReplyDelete
  11. I am having the same issue with merging. WE are on 11.1.1.7.1 - why does it merge some columns? Once we get it to excel we cannot sort because of the merging.

    ReplyDelete
    Replies
    1. Hi Clint Steiner,

      We had the same kind of issue, When we have logo or image in the title view and if we are showing compound layout (title+table) on the dashboard, then the cells are getting merged on exporting to excel sheet. To overcome this problem we have placed the title and table in different sections, so that only the table will be exported but not the image and hence the merging of cells will not happen. Please check if this scenario suits your requirement.

      Thanks,
      Nagarjuna

      Delete
  12. Hi we are currently on version 11.1.1.7.0 and we have a requirement to suppress hyperlinks that are built in to the dashboards when it is exported to Excel. The current results includes the hyperlinks as text and the users need to go through and manually remove them from the output. Is there any way to suppress the hyperlinks when it is exported?

    ReplyDelete
    Replies
    1. Hi Elly,

      We had an service request with oracle on the same issue. But Oracle Support replied saying that this is not OBIEE issue. They are saying its Excel issue. If you have an account with oracle support please check it once.

      Thanks,
      Nagarjuna

      Delete
  13. Hi,
    After exporting report to excel columns width are much more than its showing in the obiee 11g analysis.What should I do to get the exact format?

    ReplyDelete
    Replies
    1. Hi Aarti,

      Excel exports the report based on the Dashboard view. How the report is getting displayed on the dashboard the same way it will export to excel. So edit the report and place it on the dashboard in way you want it and then try exporting.

      Thanks,
      Nagarjuna

      Delete
  14. Hi Venkat,
    While scheduling the report using agents, I removed the title and retained the pivot alone. The excel continues to be of a huge size with one merged cell in output? Any idea how to prevent the unnecessary merging of columns?

    ReplyDelete
    Replies
    1. Hi Anamika,

      This is the known bug in OBIEE11g also. As of now we have no other known workaround.Oracle is working on it. Hopefully Oracle will fix this issue in future releases.

      Thanks,
      Nagarjuna

      Delete
    2. Hello Anamika, Venkat

      The following steps helped me unmerge the cells.
      1. Separate the title and table into two sections (compound views).
      2. I deleted the title section as I didn't need it (this is optional)
      3. Then, select the table in the views tab (bottom left of the screen)
      4. Once the table is selected, edit it (the pencil icon)
      5. In the new page/ pop-up, select the "table view properties" icon at the top
      6. Select the "Enable alternate styling" checkbox
      7. Select the "Repeat cell values " check box and save.

      This should take care of unmerging all the cells.

      This maybe a year since the thread was started, but hopefully it helps someone in the future.

      Thanks
      Giri

      Delete
  15. Hi ,
    I want to put password for the exported files in obiee11g.Its like after exporting the file in whatever format it should ask the password.
    can you just tell me how to do this.

    ReplyDelete
  16. Hi,
    After export excel file it's not showing Title and subtitle completely .

    Thanks,
    ilayaj shaik

    ReplyDelete
  17. When user is using BI Analytics, upon clicking ‘Analyze’ at the bottom of the result page of a report, the screen does not go to the usual edit page that we usually see.

    Please advice
    Thanks,
    Mamta

    ReplyDelete
    Replies
    1. This comment has been removed by the author.

      Delete
    2. Hi Mamta,

      Analyze option is different from Edit. Analyze will preserve the prompt default values on the dashboard where as Edit will not but both the links takes you to the Criteria or Results tab depends on your default personal settings.

      Thanks,
      Nagarjuna

      Delete