Large Excel export causes browser crash

[wd_perf]

Previous topic: https://paramquery.com/forum/index.php?topic=3908.0

I believe the crash with large data sets may be caused because of the JSZip.generate function used. According to https://stuk.github.io/jszip/documentation/faq.html the generateAsync function would do better at avoiding browser crashes.

Would you be able to update the JSZip version used to take advantage of generateAsync?

[wd_perf]

Upon further review, it looks like the crash happens before the zip, in getBody().

[paramvir]

Can you please attach sample Excel file which causes browser crash so that I can check it at my end.

[wd_perf]

Hello, yes.
https://www.stats.govt.nz/assets/Uploads/International-trade/International-trade-June-2022-quarter/Download-data/international-trade-june-2022-quarter-csv.zip
In that zip file, the output_csv_full.csv can be imported but when exported in Excel format it crashes the browser tab.
Thank you.

[wd_perf]

Hello again. I was able to get it working by removing all .join("") calls and modifying getSheet() to return buffered content as shown here: https://stackoverflow.com/a/46888173

[wd_perf]

Actually, that was breaking on very very large exports. I had to rewrite things to take advantage of JSZip3's support for Node streams in the file creation function.