C :: Assign Numbers In A Buffer To 2D Array

How to assign numbers stored in a buffer memory to a 2D array.

The data type is unsigned 16bit (unsigned short) integers and they are stored in a 16bit/2bytes*1280*1024=2621440 bytes memory. The pointer pBuffer is the starting address of the buffer. Now I initiated an array and then assign the numbers to the array.

Code:
unsigned frame[1280][1024];
for (int i=0;i<1024;i++){
for(int j=0;j<1280;j++){
frame[i][j]=(*(unsigned short*)pBuffer+1024*i+j);
printf("%u ", frame[i][j]);
}
printf("
");
}

Because I know the number in the memory, I know after running the code that the result gives me nonsense.

I tried frame[i][j]=(*(unsigned short*)pBuffer+1024*2*i+2*j);

Since I think the pointer needs to move 2 bytes at a time, but it still gives me nonsensical array back.

Am I using the wrong expression to assign the values?