memory-mapped-files Questions

5

Solved

I'm trying to find out how to remap memory-mapped files on a Mac (when I want to expand the available space). I see our friends in the Linux world have mremap but I can find no such function in t...
Plumose asked 19/8, 2010 at 11:34

3

I have a program which uses mmap() and shared memory to efficiently access a large database file. I would like to experiment with huge pages to see if it speeds things up. I thought that a quick an...
Tillandsia asked 27/4, 2012 at 0:16

1

Using .NET (dotnet 5.0) on Linux, MemoryMappedFile.CreateFromFile() works (but does not support mapName), but CreateNew() and CreateOrOpen() and OpenExisting() throw System.PlatformNotSupportedExce...
Upend asked 21/2, 2021 at 23:40

1

Solved

I want to implement the fastest possible Inter-Process Communication (IPC) (least CPU bound) between 2 .NET Core (or even mono possible) applications on Linux (SBC). I tried TPC (socket, loopbacks)...
Supportable asked 18/12, 2022 at 10:53

5

Solved

In some situations the MemoryMappedViewAccessor class just doesn't cut it for reading bytes efficiently; the best we get is the generic ReadArray<byte> which it the route for all structs and ...
Munn asked 31/10, 2011 at 15:55

3

Solved

I have a client/server app. The server component runs, uses WCF in a 'remoting' fashion (binary formatter, session objects). If I start the server component and launch the client, the first task t...
Chavannes asked 19/10, 2011 at 20:58

5

Solved

I need to read (scan) a file sequentially and process its content. File size can be anything from very small (some KB) to very large (some GB). I tried two techniques using VC10/VS2010 on Windows ...
Distributive asked 20/10, 2010 at 16:17

6

Solved

I wish to implement IPC using Named Shared Memory. To do this, one of the steps is getting a handle to a Mapping Memory Object, using CreateFileMapping(). I do it exactly as MSDN website reccom...
Paralysis asked 22/10, 2010 at 17:0

3

Solved

I saved a couple of numpy arrays with np.save(), and put together they're quite huge. Is it possible to load them all as memory-mapped files, and then concatenate and slice through all of them wit...
Kremer asked 8/12, 2012 at 19:11

1

Solved

as you can see in the code below, I'm having troubles adding new rows to a Table saved in a memory mapped file. I just want to write the file again with the new rows. import pyarrow as pa source =...
Vitovitoria asked 12/3, 2021 at 7:46

7

Solved

I need something similar to ReadToEnd or ReadAllBytes to read all of the contents of the MemoryMappedFile using the MappedViewAccessor if I don't know the size of it, how can I do it? I have searc...
Discordancy asked 19/2, 2013 at 8:56

2

I'm trying to parse a binary file integer-wise in order to check whether the integer value fulfills a certain condition but the loop is very slow. Furthermore, I found that memory-mapped files are ...
Shanta asked 20/12, 2020 at 10:24

1

Solved

I'm looking for, essentially, the ext4 equivalent of mremap(). I have a big mmap()'d file that I'm allocating arrays in, and the arrays need to grow. So I want to make the first array larger at its...
Onshore asked 8/12, 2020 at 19:41

2

I'm facing a new problem, that occured while coding my IPC for my app. Before UWP I was able to use the directive using System.IO.MemoryMappedFiles; sucessfully. Now I can't use using System.IO.Me...
Oddfellow asked 21/9, 2015 at 8:34

12

Solved

I am mapping a file("sample.txt") to memory using FileChannel.map() and then closing the channel using fc.close(). After this when I write to the file using FileOutputStream, I am getting...
Zoology asked 4/6, 2010 at 9:47

6

Solved

What limits the size of a memory-mapped file? I know it can't be bigger than the largest continuous chunk of unallocated address space, and that there should be enough free disk space. But are ther...
Tartlet asked 7/4, 2009 at 16:1

3

Solved

In my application, there is one process which writes data to a file, and then, in response to receiving a request, will send (some) of that data via the network to the requesting process. The basis...
Bear asked 22/5, 2020 at 19:20

1

This question is not a duplicate of any of these existing questions: How can I store an object File that only exists in memory as a file inside of my storage system? - This question is not about ...
Surgeon asked 9/5, 2020 at 3:16

1

Solved

I built an application that can also be ran as a service (using a -service) switch. This works perfectly with no issues when I'm running the service from a command prompt (I have something set up t...
Burden asked 30/1, 2020 at 0:38

3

Solved

I'm trying to implement custom allocator for storing memory mapped files in the std::vector. Files mapping performed by boost::iostreams::mapped_file Allocator type for file memory mapping: templ...
Beastings asked 23/7, 2014 at 2:59

3

Solved

This is the code I am using to test this: #include <iostream> #include <boost/interprocess/managed_mapped_file.hpp> #include <boost/container/map.hpp> #include <boost/interpro...
Instead asked 31/10, 2019 at 16:5

3

Solved

Is it possible to use a structure with a pointer to another structure inside a memory mapped file instead of storing the offset in some integral type and calculate the pointer? e.g. given followin...
Kovach asked 12/6, 2014 at 10:8

2

We create a file for use as memorymappedfile. we open with GENERIC_READ | GENERIC_WRITE we use share with FILE_SHARE_READ | FILE_SHARE_WRITE | FILE_SHARE_DELETE we use file attributes FILE_ATTRIBU...
Scroggins asked 13/4, 2015 at 21:33

0

We are trying to port the following code from .Net Framework to .Net Core. The code creates an in-memory memory mapped file that is accessible by applications running under different logged in acco...
Hadik asked 17/7, 2019 at 23:59

3

Solved

Is it possible to load a numpy.memmap without knowing the shape and still recover the shape of the data? data = np.arange(12, dtype='float32') data.resize((3,4)) fp = np.memmap(filename, dtype='fl...
Seaboard asked 20/4, 2016 at 15:51

© 2022 - 2024 — McMap. All rights reserved.