Memory layout of a .NET array
Asked Answered
K

4

46

What is the memory layout of a .NET array?

Take for instance this array:

Int32[] x = new Int32[10];

I understand that the bulk of the array is like this:

0000111122223333444455556666777788889999

Where each character is one byte, and the digits corresponds to indices into the array.

Additionally, I know that there is a type reference, and a syncblock-index for all objects, so the above can be adjusted to this:

ttttssss0000111122223333444455556666777788889999
        ^
        +- object reference points here

Additionally, the length of the array needs to be stored, so perhaps this is more correct:

ttttssssllll0000111122223333444455556666777788889999
        ^
        +- object reference points here

Is this complete? Are there more data in an array?

The reason I'm asking is that we're trying to estimate how much memory a couple of different in-memory representations of a rather large data corpus will take and the size of the arrays varies quite a bit, so the overhead might have a large impact in one solution, but perhaps not so much in the other.

So basically, for an array, how much overhead is there, that is basically my question.

And before the arrays are bad squad wakes up, this part of the solution is a static build-once-reference-often type of thing so using growable lists is not necessary here.

Kleenex answered 28/1, 2009 at 10:44 Comment(1)
Just a little note: the syncblock comes before the methodtype reference. The variable holds a pointer (reference) to the methodtype reference (tttt above), skipping the syncblock part. The layout actually looks like ssssttttllll000011...9999NULL for arrays without specific dimensions or specific lower bounds.Vinegarette
P
7

Great question. I found this article which contains block diagrams for both value types and reference types. Also see this article in which Ritcher states:

[snip] each array has some additional overhead information associated with it. This information contains the rank of the array (number of dimensions), the lower bounds for each dimension of the array (almost always 0), and the length of each dimension. The overhead also contains the type of each element in the array.

Pongid answered 28/1, 2009 at 11:28 Comment(3)
May I suggest adding Code Project's "Arrays UNDOCUMENTED" article to this solution: codeproject.com/KB/dotnet/arrays.aspxPelkey
The book that that snip comes from is called "CLR via C#" and it's a fantastic book.Dated
Can't agree more with SnOrfus - superb book.Pongid
S
21

One way to examine this is to look at the code in WinDbg. So given the code below, let's see how that appears on the heap.

var numbers = new Int32[] { 0, 1, 2, 3, 4, 5, 6, 7, 8, 9 };

The first thing to do is to locate the instance. As I have made this a local in Main(), it is easy to find the address of the instance.

From the address we can dump the actual instance, which gives us:

0:000> !do 0x0141ffc0
Name: System.Int32[]
MethodTable: 01309584
EEClass: 01309510
Size: 52(0x34) bytes
Array: Rank 1, Number of elements 10, Type Int32
Element Type: System.Int32
Fields:
None

This tells us that it is our Int32 array with 10 elements and a total size of 52 bytes.

Let's dump the memory where the instance is located.

0:000> d 0x0141ffc0
0141ffc0 [84 95 30 01 0a 00 00 00-00 00 00 00 01 00 00 00  ..0.............
0141ffd0  02 00 00 00 03 00 00 00-04 00 00 00 05 00 00 00  ................
0141ffe0  06 00 00 00 07 00 00 00-08 00 00 00 09 00 00 00  ................
0141fff0  00 00 00 00]a0 20 40 03-00 00 00 00 00 00 00 00  ..... @.........
01420000  00 00 00 00 00 00 00 00-00 00 00 00 00 00 00 00  ................
01420010  10 6d 99 00 00 00 00 00-00 00 01 40 50 f7 3d 03  .m.........@P.=.
01420020  03 00 00 00 08 00 00 00-00 01 00 00 00 00 00 00  ................
01420030  1c 24 40 03 00 00 00 00-00 00 00 00 00 00 00 00  .$@.............

I have inserted brackets for the 52 bytes.

  • The first four bytes are the reference to the method table at 01309584.
  • Then four bytes for the Length of the array.
  • Following that are the numbers 0 to 9 (each four bytes).
  • The last four bytes are null. I'm not entirely sure, but I guess that must be where the reference to the syncblock array is stored if the instance is used for locking.

Edit: Forgot length in first posting.

The listing is slightly incorrect because as romkyns points out the instance actually begins at the address - 4 and the first field is the Syncblock.

Stantonstanway answered 28/1, 2009 at 12:21 Comment(2)
The last four bytes are actually outside of this array. This is because the pointer you get is offset by 4 into the object; the syncblock index comes first at offset -4. referenceDismantle
"The first four bytes are the reference to the method table at 01309510." - shouldn't be "at 01309584" ?Halfhearted
E
8

Great question! I wanted to see it for myself, and it seemed a good opportunity to try out CorDbg.exe...

It seems that for simple integer arrays, the format is:

ssssllll000011112222....nnnn0000

where s is the sync block, l the length of the array, and then the individual elements. It seems that there is a finally 0 at the end, I'm not sure why that is.

For multidimensional arrays:

ssssttttl1l1l2l2????????
    000011112222....nnnn000011112222....nnnn....000011112222....nnnn0000

where s is the sync block, t the total number of elements, l1 the length of the first dimension, l2 the length of the second dimension, then two zeroes?, followed by all the elements sequentially, and finally a zero again.

Object arrays are treated as the integer array, the contents are references this time. Jagged arrays are object arrays where the references point to other arrays.

Elora answered 28/1, 2009 at 12:3 Comment(0)
P
7

Great question. I found this article which contains block diagrams for both value types and reference types. Also see this article in which Ritcher states:

[snip] each array has some additional overhead information associated with it. This information contains the rank of the array (number of dimensions), the lower bounds for each dimension of the array (almost always 0), and the length of each dimension. The overhead also contains the type of each element in the array.

Pongid answered 28/1, 2009 at 11:28 Comment(3)
May I suggest adding Code Project's "Arrays UNDOCUMENTED" article to this solution: codeproject.com/KB/dotnet/arrays.aspxPelkey
The book that that snip comes from is called "CLR via C#" and it's a fantastic book.Dated
Can't agree more with SnOrfus - superb book.Pongid
B
0

An array object would have to store how many dimensions it has and the length of each dimension. So there is at least one more data element to add to your model

Broadfaced answered 28/1, 2009 at 11:14 Comment(0)

© 2022 - 2024 — McMap. All rights reserved.