I think the person who originally set up the server used windows to create a partition table so Linux could boot off of the array. Possibly to get around GPT partitioning?<div><br></div><div>In the RAID setup, I created two logical drives, a 200 GB drive for /boot, /, and the MBR, and a logical drive for the remainder of the 3.5TB of storage.</div>
<div><br></div><div>I re-installed debian, and after the install, I set up the second logical drive as a large LVM physical volume, created a large LVM group on top of that, and created a single large LVM logical volume on top of that. So far, so good.</div>
<div><br></div><div><br></div><div><div>~# pvs -v</div><div>Scanning for physical volume names</div><div>PV VG Fmt Attr PSize PFree DevSize PV UUID</div><div>/dev/cciss/c0d1 bigstorevg lvm2 a- 3.22T 0 3.22T lMjnFR-uAQ4-iBYT-rh17-egkN-q3Wi-BF0sSV</div>
<div><br></div><div><br></div><div><div>~# pvdisplay</div><div> --- Physical volume ---</div><div> PV Name /dev/cciss/c0d1</div><div> VG Name bigstorevg</div><div> PV Size 3.22 TB / not usable 2.93 MB</div>
<div> Allocatable yes (but full)</div><div> PE Size (KByte) 4096</div><div> Total PE 844215</div><div> Free PE 0</div><div> Allocated PE 844215</div><div><br></div>
<div><br></div><div><div>~# vgscan</div><div> Reading all physical volumes. This may take a while...</div><div> Found volume group "bigstorevg" using metadata type lvm2</div><div><br></div><div><br></div><div>
<div>~# lvdisplay</div><div> --- Logical volume ---</div><div> LV Name /dev/bigstorevg/bigstorelv</div><div> VG Name bigstorevg</div><div> LV UUID M0A2b9-N6el-Qxsu-r8Lq-qBn2-efnM-2MsGkZ</div>
<div> LV Write Access read/write</div><div> LV Status available</div><div> # open 1</div><div> LV Size 3.22 TB</div><div> Current LE 844215</div><div> Segments 1</div>
<div> Allocation inherit</div><div> Read ahead sectors auto</div><div> - currently set to 256</div><div> Block device 254:0</div><div><br></div><div><br></div><div><div>~# df -h</div><div>
Filesystem Size Used Avail Use% Mounted on</div><div>/dev/cciss/c0d0p3 189G 612M 179G 1% /</div><div>tmpfs 1.8G 0 1.8G 0% /lib/init/rw</div><div>udev 10M 88K 10M 1% /dev</div>
<div>tmpfs 1.8G 0 1.8G 0% /dev/shm</div><div>/dev/cciss/c0d0p1 236M 15M 209M 7% /boot</div><div>/dev/mapper/bigstorevg-bigstorelv</div><div> 3.2T 199M 3.1T 1% /storage</div>
<div><br></div></div></div></div></div><div><br></div>
<br><div class="gmail_quote">On Wed, Jan 7, 2009 at 8:43 PM, teh test3s <span dir="ltr"><<a href="mailto:tehtest3s@gmail.com" target="_blank">tehtest3s@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
That's a GREAT question. The really weird thing is that the RAID array in question *does* actually have 3.2 TB of free space in it! (5 x 750GB SATA in RAID 5 array). I am completely baffled.<div><br></div><div><div>
~# blockdev --report</div><div>RO RA SSZ BSZ StartSec Size Device</div><div>rw 256 512 4096 0 409599360 /dev/cciss/c0d0</div><div>rw 256 512 512 63 409593177 /dev/cciss/c0d0p1</div>
<div>rw 256 512 4096 0 6915815280 /dev/cciss/c0d1</div><div>rw 256 512 1024 63 497952 /dev/cciss/c0d1p1</div><div>rw 256 512 4096 498015 7807590 /dev/cciss/c0d1p2</div><div>rw 256 512 1024 8305605 2 /dev/cciss/c0d1p3</div>
<div>rw 256 512 512 8305668 2612532821 /dev/cciss/c0d1p5</div><div>rw 256 512 4096 0 409591808 /dev/dm-0</div><div><div></div><div><div><br></div><br><div class="gmail_quote">On Wed, Jan 7, 2009 at 8:35 PM, Alasdair G Kergon <span dir="ltr"><<a href="mailto:agk@redhat.com" target="_blank">agk@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div>On Wed, Jan 07, 2009 at 08:23:36PM -0500, teh test3s wrote:<br>
> PV VG Fmt Attr PSize PFree DevSize PV UUID<br>
</div><div>> /dev/cciss/c0d1p5 volgroup00 lvm2 a- 3.22T 2.22T 1.22T<br>
> wF9oyR-R0tf-bZeW-0es1-FhYK-f2g3-xS1Rd9<br>
<br>
</div>So that's what you need to explain:<br>
<br>
How come LVM thinks that device is 3.22T while it's really only 1.22T ?<br>
<br>
Presumably blockdev --getsize will tell you the same.<br>
<br>
IOW It's not an LVM issue. Check your cciss partitioning.<br>
<br>
Alasdair<br>
<font color="#888888">--<br>
<a href="mailto:agk@redhat.com" target="_blank">agk@redhat.com</a><br>
</font></blockquote></div><br></div></div></div>
</blockquote></div><br></div>