# Big data file

**URL:** <https://mworks.discourse.group/t/big-data-file/301>\
**Category:** Support\
**Created:** [September 21, 2018, 1:58pm UTC](https://mworks.discourse.group/t/big-data-file/301 "2018-09-21T13:58:14Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![cstawarz](https://yyz1.discourse-cdn.com/flex031/user_avatar/mworks.discourse.group/cstawarz/32/3_2.png) [@cstawarz](https://mworks.discourse.group/u/cstawarz)\
**Post date:** [September 21, 2018, 1:58pm UTC](https://mworks.discourse.group/t/big-data-file/301/1 "2018-09-21T13:58:14Z")

</div>

Hi Chris,

My mworks datafile is somehow 20GB (need to figure out why). Is it possible to read some variables from the file without using too much RAM or loading the entire file?

Thanks,

–  
Sujay

---

<div class="post-metadata">

**Author:** ![cstawarz](https://yyz1.discourse-cdn.com/flex031/user_avatar/mworks.discourse.group/cstawarz/32/3_2.png) [@cstawarz](https://mworks.discourse.group/u/cstawarz)\
**Post date:** [September 21, 2018, 2:00pm UTC](https://mworks.discourse.group/t/big-data-file/301/2 "2018-09-21T14:00:06Z")

</div>

Hi Chris,

The file was 15GB today. There’s something weird happening. Can I drop by to ask you a question tomorrow morning?

---

<div class="post-metadata">

**Author:** ![cstawarz](https://yyz1.discourse-cdn.com/flex031/user_avatar/mworks.discourse.group/cstawarz/32/3_2.png) [@cstawarz](https://mworks.discourse.group/u/cstawarz)\
**Post date:** [September 21, 2018, 2:03pm UTC](https://mworks.discourse.group/t/big-data-file/301/3 "2018-09-21T14:03:14Z")

</div>

Hi Sujay,

> Is it possible to read some variables from the file without using too much RAM or loading the entire file?

Yes, but only in Python (not MATLAB). Please see the paragraph about `get_events_iter` in [Selecting Events](https://mworks.github.io/documentation/latest/guide/data_analysis.html#selecting-events).

> Can I drop by to ask you a question tomorrow morning?

Sure.

Chris

---

<div class="post-metadata">

**Author:** ![cstawarz](https://yyz1.discourse-cdn.com/flex031/user_avatar/mworks.discourse.group/cstawarz/32/3_2.png) [@cstawarz](https://mworks.discourse.group/u/cstawarz)\
**Post date:** [July 19, 2022, 9:40pm UTC](https://mworks.discourse.group/t/big-data-file/301/4 "2022-07-19T21:40:10Z")

</div>

Closed on July 19, 2022, 9:40pm UTC