HP Proliant Raid: различия между версиями

Материал из noname.com.ua
Перейти к навигацииПерейти к поиску
 
(не показано 140 промежуточных версий этого же участника)
Строка 1: Строка 1:
  +
[[Категория:Hardware]]
  +
[[Категория:Raid]]
  +
[[Категория:Proliant]]
  +
[[Категория:HP]]
  +
[[Категория:Linux]]
  +
 
=Raid на серверах HP=
  
=Raid на серверах HP=
   
  +
Мне достались 2 сервера с разными контроллерами
−
=DL180 G6=
  
  +
* P410 с кешем и H240 без кеша
  +
  +
{| class="wikitable"
  +
|+ Контроллеры
  +
|-
  +
!
  +
<code>P410</code>
  +
!
  +
<code>H240</code>
  +
|-
  +
|
   
 
<PRE>
  
<PRE>
−
lspci | grep -i raid
 +
lspci -s 09:00.0 -vv
 
09:00.0 RAID bus controller: Hewlett-Packard Company Smart Array G6 controllers (rev 01)
  
09:00.0 RAID bus controller: Hewlett-Packard Company Smart Array G6 controllers (rev 01)
  +
Subsystem: Hewlett-Packard Company Smart Array P410
  +
</PRE>
  +
||
  +
  +
<PRE>
  +
lspci -s 06:00.0 -vv
  +
06:00.0 RAID bus controller: Hewlett-Packard Company Smart Array Gen9 Controllers (rev 01)
  +
Subsystem: Hewlett-Packard Company H240
 
</PRE>
  
</PRE>
   
  +
|-
−
{{#spoiler:show=lspci -vv -s 09:00.0|
  
  +
|
   
 
<PRE>
  
<PRE>
−
lspci -vv -s 09:00.0
  
 
09:00.0 RAID bus controller: Hewlett-Packard Company Smart Array G6 controllers (rev 01)
  
09:00.0 RAID bus controller: Hewlett-Packard Company Smart Array G6 controllers (rev 01)
 
Subsystem: Hewlett-Packard Company Smart Array P410
  
Subsystem: Hewlett-Packard Company Smart Array P410
Строка 38: Строка 63:
 
LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk-
  
LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk-
 
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
  
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
−
LnkSta: Speed 2.5GT/s (downgraded), Width x8 (ok)
 +
LnkSta: Speed 5GT/s (ok), Width x8 (ok)
 
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
  
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
 
DevCap2: Completion Timeout: Not Supported, TimeoutDis+ NROPrPrP- LTR-
  
DevCap2: Completion Timeout: Not Supported, TimeoutDis+ NROPrPrP- LTR-
Строка 50: Строка 75:
 
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
  
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
 
Compliance De-emphasis: -6dB
  
Compliance De-emphasis: -6dB
−
LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete- EqualizationPhase1-
 +
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
 
EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
  
EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
 
Retimer- 2Retimers- CrosslinkRes: unsupported
  
Retimer- 2Retimers- CrosslinkRes: unsupported
Строка 68: Строка 93:
 
Kernel modules: hpsa
  
Kernel modules: hpsa
 
</PRE>
  
</PRE>
  +
||
−
}}
  
  +
<PRE>
  +
lspci -s 06:00.0 -vv
  +
06:00.0 RAID bus controller: Hewlett-Packard Company Smart Array Gen9 Controllers (rev 01)
  +
Subsystem: Hewlett-Packard Company H240
  +
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx+
  +
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
  +
Latency: 0, Cache Line Size: 256 bytes
  +
Interrupt: pin A routed to IRQ 57
  +
Region 0: Memory at fbd00000 (64-bit, non-prefetchable) [size=1M]
  +
Region 2: Memory at fbcffc00 (64-bit, non-prefetchable) [size=1K]
  +
Region 4: I/O ports at d800 [size=256]
  +
Expansion ROM at fbc00000 [disabled] [size=512K]
  +
Capabilities: [80] Power Management version 3
  +
Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
  +
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
  +
Capabilities: [90] MSI: Enable- Count=1/32 Maskable- 64bit+
  +
Address: 0000000000000000 Data: 0000
  +
Capabilities: [b0] MSI-X: Enable+ Count=64 Masked-
  +
Vector table: BAR=0 offset=00002000
  +
PBA: BAR=0 offset=00003000
  +
Capabilities: [c0] Express (v2) Endpoint, MSI 00
  +
DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <4us, L1 <1us
  +
ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
  +
DevCtl: CorrErr- NonFatalErr+ FatalErr+ UnsupReq-
  +
RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
  +
MaxPayload 256 bytes, MaxReadReq 4096 bytes
  +
DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
  +
LnkCap: Port #0, Speed 8GT/s, Width x8, ASPM not supported
  +
ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
  +
LnkCtl: ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
  +
ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
  +
LnkSta: Speed 5GT/s (downgraded), Width x8 (ok)
  +
TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
  +
DevCap2: Completion Timeout: Range B, TimeoutDis+ NROPrPrP- LTR-
  +
10BitTagComp- 10BitTagReq- OBFF Via message, ExtFmt- EETLPPrefix-
  +
EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
  +
FRS- TPHComp+ ExtTPHComp-
  +
AtomicOpsCap: 32bit+ 64bit+ 128bitCAS+
  +
DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- OBFF Disabled,
  +
AtomicOpsCtl: ReqEn-
  +
LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
  +
LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
  +
Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
  +
Compliance De-emphasis: -6dB
  +
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
  +
EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
  +
Retimer- 2Retimers- CrosslinkRes: unsupported
  +
Capabilities: [100 v2] Advanced Error Reporting
  +
UESta: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
  +
UEMsk: DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
  +
UESvrt: DLP+ SDES+ TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
  +
CESta: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
  +
CEMsk: RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
  +
AERCap: First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
  +
MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
  +
HeaderLog: 00000000 00000000 00000000 00000000
  +
Capabilities: [300 v1] Secondary PCI Express
  +
LnkCtl3: LnkEquIntrruptEn- PerformEqu-
  +
LaneErrStat: 0
  +
Kernel driver in use: hpsa
  +
Kernel modules: hpsa
  +
</PRE>
  +
|-
  +
|
  +
Модуль ядра: <code>hpsa</code>
  +
||
  +
Модуль ядра: <code>hpsa</code>
  +
|}
   
−
==Утилиты==
 +
=Утилиты=
  +
  +
Для обоих контроллеров можно использовать новую утилиту <code>ssacli</code> (Smart Storage Admin CLI),<BR>
  +
которая заменяет более старые <code>hpacucli</code> и <code>hpssacli</code>, однако на момент <BR>
  +
начала работы я этого не знал, и для <code>P410</code> использовал более старую утилиту
  +
  +
{| class="wikitable"
  +
|+ Утилиты
  +
<BR>
  +
Общее место где можно искать утилиты:
 
* https://downloads.linux.hpe.com/SDR/repo/mcp/ubuntu/pool/non-free/
  
* https://downloads.linux.hpe.com/SDR/repo/mcp/ubuntu/pool/non-free/
  +
* http://hwraid.le-vert.net/wiki
−
(я доставал файлы так как в пакете сломаны зависимости)
  
  +
  +
  +
|-
  +
!
  +
<code>P410</code>
  +
!
  +
<code>H240</code>
  +
|-
  +
|
  +
[[File:Hpacucli 9.40.1-1. amd64.deb]]
  +
  +
<PRE>
  +
wget https://downloads.linux.hpe.com/SDR/repo/mcp/ubuntu/pool/non-free/hpacucli_9.40.1-1._amd64.deb
  +
</PRE>
  +
  +
||
  +
[[File:Ssacli-6.15-11.0 amd64.deb]]
  +
  +
<PRE>
  +
wget https://downloads.linux.hpe.com/SDR/repo/mcp/ubuntu/pool/non-free/ssacli-6.15-11.0_amd64.deb
  +
</PRE>
  +
  +
  +
|}
   
 
==Сокращения, которые можно использовать в командах==
  
==Сокращения, которые можно использовать в командах==
Строка 82: Строка 208:
 
* <code>drivewritecache</code> = <code>dwc</code>
  
* <code>drivewritecache</code> = <code>dwc</code>
   
−
==Просмотр конфигурации==
 +
=Просмотр конфигурации=
  +
  +
  +
{| class="wikitable"
  +
|+ Просмотр конфигурации
  +
|-
  +
! <code>P410</code> !!! <code>H240</code>
  +
|-
  +
|
  +
 
<PRE>
  
<PRE>
−
hpacucli ctrl all show config
 +
hpacucli ctrl all show config detail
 
</PRE>
  
</PRE>
  +
  +
||
  +
 
<PRE>
  
<PRE>
  +
ssacli ctrl all show config detail
  +
</PRE>
  +
  +
|-
  +
|
  +
  +
<PRE>
  +
hpacucli ctrl all show config
 
Smart Array P410 in Slot 1 (sn: PACCR9SYRIHU )
  
Smart Array P410 in Slot 1 (sn: PACCR9SYRIHU )
 
unassigned
  
unassigned
Строка 92: Строка 238:
 
SEP (Vendor ID PMCSIERA, Model SRC 8x6G) 250 (WWID: 5001438006116C2F)
  
SEP (Vendor ID PMCSIERA, Model SRC 8x6G) 250 (WWID: 5001438006116C2F)
 
</PRE>
  
</PRE>
  +
−
Тут в примере - один диск который включен но никак не настроен
  
  +
||
−
<BR>
  
−
Более детально: {{#spoiler:show=hpacucli ctrl all show config detail|
  
   
 
<PRE>
  
<PRE>
−
hpacucli ctrl all show config detail
 +
ssacli ctrl all show config
   
  +
Smart HBA H240 in Slot 255 (RAID Mode) (sn: PDNNK0BRHAE1PT)
  +
Port Name: 1I
  +
Port Name: 2I
  +
</PRE>
  +
  +
|-
  +
|
  +
  +
<PRE>
 
Smart Array P410 in Slot 1
  
Smart Array P410 in Slot 1
 
Bus Interface: PCI
  
Bus Interface: PCI
Строка 146: Строка 300:
 
Vendor ID: PMCSIERA
  
Vendor ID: PMCSIERA
 
Model: SRC 8x6G
  
Model: SRC 8x6G
  +
</PRE>
  +
  +
||
  +
  +
<PRE>
  +
ssacli ctrl all show config detail
  +
  +
Smart HBA H240 in Slot 255 (RAID Mode)
  +
Bus Interface: PCI
  +
Slot: 255
  +
Serial Number: PDNNK0BRHAE1PT
  +
Cache Serial Number: PDNNK0BRHAE1PT
  +
Controller Status: OK
  +
Hardware Revision: B
  +
Firmware Version: 6.30
  +
Firmware Supports Online Firmware Activation: False
  +
Wait for Cache Room: Disabled
  +
Surface Analysis Inconsistency Notification: Disabled
  +
Post Prompt Timeout: 0 secs
  +
Cache Board Present: False
  +
Drive Write Cache: Disabled
  +
Controller Memory Size: 0.2
  +
SATA NCQ Supported: True
  +
Spare Activation Mode: Activate on physical drive failure (default)
  +
Controller Temperature (C): 33
  +
Number of Ports: 2 Internal only
  +
Encryption: Not Set
  +
Express Local Encryption: False
  +
Driver Name: hpsa
  +
Driver Version: 3.4.20
  +
WWN Port: 5001438042CA2050
  +
Driver Supports SSD Smart Path: True
  +
PCI Address (Domain:Bus:Device.Function): 0000:06:00.0
  +
Negotiated PCIe Data Rate: PCIe 2.0 x8 (4000 MB/s)
  +
Controller Mode: RAID Mode
  +
Pending Controller Mode: RAID
  +
Controller Mode Reboot: Not Required
  +
Port Max Phy Rate Limiting Supported: False
  +
Latency Scheduler Setting: Disabled
  +
Current Power Mode: MaxPerformance
  +
Survival Mode: Enabled
  +
Host Serial Number: 2M2812021S
  +
Sanitize Erase Supported: True
  +
Primary Boot Volume: Unknown (600508B1001C2F75860BC680F0767397)
  +
Secondary Boot Volume: Unknown (600508B1001C2F75860BC680F0767397)
  +
SPDM Supports Get Slot Certificate Chain: no
  +
SPDM Supports Get Controller Info : no
  +
SPDM Supports Get Slot Info : no
  +
SPDM Supports Set Import Certificate : no
  +
SPDM Supports Set Invalidate Slot : no
  +
Surface Scan Completion Supported: False
  +
Persistent Event Log Policy Change Supported: False
  +
</PRE>
  +
  +
Тут не показаны подключенные диски так как их не было на момент написания
  +
  +
  +
|}
  +
  +
=Статус контроллера=
  +
{| class="wikitable"
  +
|+ Статус контроллера
  +
|-
  +
! <code>P410</code> !! <code>H240</code>
  +
|-
  +
|
  +
<PRE>
  +
hpacucli ctrl all show status
  +
</PRE>
  +
||
  +
<PRE>
  +
ssacli ctrl all show status
  +
</PRE>
  +
|-
  +
|
  +
<PRE>
  +
Smart Array P410 in Slot 1
  +
Controller Status: OK
  +
Cache Status: Not Configured
  +
</PRE>
  +
||
  +
<PRE>
  +
  +
Smart HBA H240 in Slot 255 (RAID Mode)
  +
Controller Status: OK
  +
</PRE>
  +
|}
  +
  +
=Управление кэшированием=
  +
  +
{| class="wikitable"
  +
|+ Управление кэшированием
  +
|-
  +
! <code>P410</code> !! <code>H240</code>
  +
|-
  +
|
  +
  +
<PRE>
  +
hpacucli ctrl slot=1 modify dwc=disable
  +
  +
Error: This operation is not supported with the current configuration. Use the
  +
"show" command on devices to show additional details about the
  +
configuration.
  +
Reason: Controller not configured
  +
</PRE>
  +
||
  +
  +
<PRE>
  +
ssacli controller slot=255 modify dwc=disable
  +
</PRE>
  +
|-
  +
|
  +
<PRE>
  +
hpacucli ctrl slot=1 modify dwc=enable
  +
  +
Warning: Without the proper safety precautions, use of write cache on physical
  +
drives could cause data loss in the event of power failure. To ensure
  +
data is properly protected, use redundant power supplies and
  +
Uninterruptible Power Supplies. Also, if you have multiple storage
  +
enclosures, all data should be mirrored across them. Use of this
  +
feature is not recommended unless these precautions are followed.
  +
Continue? (y/n)
  +
</PRE>
  +
  +
У меня не включился, думаю из-за
  +
<PRE>
  +
Battery/Capacitor Count: 0
  +
</PRE>
  +
  +
||
  +
  +
<PRE>
  +
ssacli controller slot=255 modify dwc=enable
  +
  +
Warning: Without the proper safety precautions, use of write cache on physical
  +
drives could cause data loss in the event of power failure. To ensure
  +
data is properly protected, use redundant power supplies and
  +
Uninterruptible Power Supplies. Also, if you have multiple storage
  +
enclosures, all data should be mirrored across them. Use of this
  +
feature is not recommended unless these precautions are followed.
  +
Continue? (y/n) y
  +
</PRE>
  +
Без батареи но включилось:
  +
<PRE>
  +
ssacli controller slot=255 show detail | grep 'Drive Write Cache'
  +
Drive Write Cache: Enabled
  +
</PRE>
  +
|}
  +
  +
=Пересканировать устройства=
  +
  +
{| class="wikitable"
  +
|+ Пересканировать устройства, добавленные с момента последнего сканирования
  +
  +
|-
  +
! <code>P410</code>!! <code>H240</code>
  +
|-
  +
|
  +
<PRE>
  +
hpacucli rescandetects newly added devices since the last rescan
  +
</PRE>
  +
В моем случае ни к чему не привело - диск нашелся сам по себе
  +
  +
||
  +
  +
<PRE>
  +
ssacli rescan
  +
</PRE>
  +
Мне не помогло, изначально диски не видились, не ясно был ли плохо вставлен кабель или помогло отключение и включение питания (изначально диски были вставлены на-горячую)
  +
|}
  +
  +
=Просмотр информации о дисках=
  +
  +
  +
{| class="wikitable"
  +
|+ Просмотр информации о дисках
  +
|-
  +
! <code>P410</code> !! <code>H240</code>
  +
|-
  +
|
  +
  +
Все диски:
  +
<PRE>
  +
hpacucli controller slot=1 pd all show status
  +
physicaldrive 2I:1:3 (port 2I:box 1:bay 3, 300 GB): OK
  +
</PRE>
  +
  +
||
  +
  +
Все диски:
  +
<PRE>
  +
ssacli controller slot=255 pd all show status
  +
  +
physicaldrive 1I:0:7 (port 1I:box 0:bay 7, 300 GB): OK
  +
physicaldrive 1I:0:6 (port 1I:box 0:bay 6, 200 GB): OK
  +
physicaldrive 1I:0:8 (port 1I:box 0:bay 8, 300 GB): OK
  +
</PRE>
  +
  +
|-
  +
|
  +
  +
<PRE>
  +
hpacucli ctrl slot=1 pd 2I:1:3 show detail
  +
</PRE>
  +
  +
||
  +
  +
<PRE>
  +
ssacli controller slot=255 pd 1I:0:7 show detail
  +
</PRE>
  +
  +
|-
  +
|
  +
  +
<PRE>
  +
Smart Array P410 in Slot 1
  +
unassigned
  +
physicaldrive 2I:1:3
  +
Port: 2I
  +
Box: 1
  +
Bay: 3
  +
Status: OK
  +
Drive Type: Unassigned Drive
  +
Interface Type: SAS
  +
Size: 300 GB
  +
Rotational Speed: 10000
  +
Firmware Revision: HPD7
  +
Serial Number: 6XP5CLK80000B335CPL7
  +
Model: HP EG0300FBLSE
  +
PHY Count: 2
  +
PHY Transfer Rate: 6.0Gbps, Unknown
  +
</PRE>
  +
  +
Во многих примерах приводят <code>pd 2:3 </code> (2-х значный адрес) <BR>
  +
вместо <code>pd 2I:1:3</code> (3-х значный), возможно связано с версией контроллера или утилит.
  +
  +
||
  +
  +
<PRE>
  +
Smart HBA H240 in Slot 255
  +
Array A
  +
physicaldrive 1I:0:7
  +
Port: 1I
  +
Box: 0
  +
Bay: 7
  +
Status: OK
  +
Drive Type: Data Drive
  +
Interface Type: SAS
  +
Size: 300 GB
  +
Drive exposed to OS: False
  +
Logical/Physical Block Size: 512/512
  +
Rotational Speed: 10000
  +
Firmware Revision: HPD7
  +
Serial Number: 6XP5CLK80000B335CPL7
  +
WWID: 5000C5005FBBAA91
  +
Model: HP EG0300FBLSE
  +
Current Temperature (C): 31
  +
Maximum Temperature (C): 58
  +
PHY Count: 2
  +
PHY Transfer Rate: 6.0Gbps, Unknown
  +
PHY Physical Link Rate: Unknown, Unknown
  +
PHY Maximum Link Rate: Unknown, Unknown
  +
Drive Authentication Status: Not Applicable
  +
Sanitize Erase Supported: False
  +
Shingled Magnetic Recording Support: None
  +
</PRE>
  +
  +
|-
  +
|
  +
  +
<BR>
  +
Сам адрес диска, если он не известен можно посмотреть в <code> hpacucli ctrl all show config detail </code><BR>
  +
Часть вывода пропущена
  +
<PRE>
  +
physicaldrive 2I:1:3
  +
Port: 2I
  +
Box: 1
  +
Bay: 3
  +
</PRE>
  +
  +
||
  +
Сам адрес диска, если он не известен можно посмотреть в <code> ssacli ctrl all show config detail </code><BR>
  +
Часть вывода пропущена
  +
<PRE>
  +
physicaldrive 1I:0:7
  +
Port: 1I
  +
Box: 0
  +
Bay: 7
  +
</PRE>
  +
|}
  +
  +
=Очистка=
  +
  +
Перед очисткой, если диск находится в логической группе, его нужно вывести или удалить группу, например так:
  +
<PRE>
  +
ssacli ctrl slot=255 ld 1 delete
  +
</PRE>
  +
{| class="wikitable"
  +
|+ Очистка
  +
|-
  +
! <code>P410</code>!! <code>H240</code>
  +
|-
  +
|
  +
<PRE>
  +
hpacucli ctrl slot=1 pd 2I:1:3 modify erase
  +
</PRE>
  +
||
  +
<PRE>
  +
ssacli ctrl slot=255 pd 1I:0:7 modify erase
  +
</PRE>
  +
|}
  +
После очистки нужно заново включить диск
  +
<PRE>
  +
ssacli ctrl slot=255 pd 1I:0:7 modify enableeraseddrive
  +
</PRE>
  +
  +
=Управление диодами на дисках=
  +
  +
{| class="wikitable"
  +
|+ Управление диодами на дисках
  +
|-
  +
! <code>P410</code>!! <code>H240</code>
  +
|-
  +
|
  +
  +
<PRE>
  +
hpacucli ctrl slot=1 pd 2I:1:3 modify led=on
  +
</PRE>
  +
||
  +
  +
<PRE>
  +
ssacli ctrl slot=255 pd 1I:0:7 modify led=on
  +
</PRE>
  +
|-
  +
|
  +
  +
<PRE>
  +
hpacucli ctrl slot=1 pd 2I:1:3 modify led=off
  +
</PRE>
  +
  +
||
  +
  +
<PRE>
  +
ssacli ctrl slot=255 pd 1I:0:7 modify led=off
  +
</PRE>
  +
  +
  +
|}
  +
  +
=Показать информацию (детально)=
  +
  +
  +
{| class="wikitable"
  +
|+ Показать информацию (детально)
  +
|-
  +
! <code>P410</code>!! <code>H240</code>
  +
|-
  +
|
  +
  +
<PRE>
  +
hpacucli ctrl slot=1 ld all show detail
  +
  +
Error: The specified device does not have any logical drives.
  +
</PRE>
  +
  +
||
  +
  +
<PRE>
  +
ssacli ctrl slot=255 ld all show detail
  +
  +
Error: The specified device does not have any logical drives.
  +
</PRE>
  +
  +
|}
  +
  +
Логических дисков пока нет
  +
  +
=Создание дисков=
  +
  +
Нельзя добавлять диски в процессе очистки, по-тому далее вместо <code>1I:0:7</code> использую <code>1I:0:8</code>
  +
<BR>
  +
Это видно например так (Erase In Progress)
  +
<PRE>
  +
ssacli ctrl slot=255 pd all show
  +
  +
Smart HBA H240 in Slot 255
  +
Unassigned
  +
physicaldrive 1I:0:6 (port 1I:box 0:bay 6, SATA SSD, 200 GB, OK)
  +
physicaldrive 1I:0:7 (port 1I:box 0:bay 7, SAS HDD, 300 GB, Erase In Progress)
  +
physicaldrive 1I:0:8 (port 1I:box 0:bay 8, SAS HDD, 300 GB, OK)
  +
</PRE>
  +
  +
{| class="wikitable"
  +
|+ Создание дисков
  +
|-
  +
! <code>P410</code>!! <code>H240</code>
  +
|-
  +
|
  +
  +
логический диск (отдельный диск). Команда не возвращает вывод, результат смотреть отдельно.
  +
<PRE>
  +
hpacucli ctrl slot=1 create type=ld drives=2I:1:3 raid=0
  +
</PRE>
  +
  +
||
  +
  +
<PRE>
  +
ssacli ctrl slot=255 create type=ld drives=1I:0:8 raid=0
  +
</PRE>
  +
  +
|-
  +
|
  +
  +
Просмотреть что вышло?
  +
<PRE>
  +
hpacucli ctrl slot=1 ld all show detail
  +
  +
Smart Array P410 in Slot 1
  +
  +
array A
  +
  +
Logical Drive: 1
  +
Size: 279.4 GB
  +
Fault Tolerance: 0
  +
Heads: 255
  +
Sectors Per Track: 32
  +
Cylinders: 65535
  +
Strip Size: 256 KB
  +
Full Stripe Size: 256 KB
  +
Status: OK
  +
Caching: Enabled
  +
Unique Identifier: 600508B1001C8823B6E46FDAC58243EC
  +
Disk Name: /dev/sdb
  +
Mount Points: None
  +
Logical Drive Label: A7044617PACCR9SYRIHUC7C6
  +
Drive Type: Data
  +
</PRE>
  +
||
  +
  +
<PRE>
  +
ssacli ctrl slot=255 ld all show detail
  +
  +
Smart HBA H240 in Slot 255
  +
  +
Array A
  +
  +
Logical Drive: 1
  +
Size: 279.37 GB
  +
Fault Tolerance: 0
  +
Heads: 255
  +
Sectors Per Track: 32
  +
Cylinders: 65535
  +
Strip Size: 256 KB
  +
Full Stripe Size: 256 KB
  +
Status: OK
  +
MultiDomain Status: OK
  +
Caching: Disabled
  +
Last Surface Scan Completed: False
  +
Unique Identifier: 600508B1001CE2A17D6A7F43F07AE289
  +
Disk Name: /dev/sda
  +
Mount Points: None
  +
Logical Drive Label: Logical Drive 1
  +
Drive Type: Data
  +
LD Acceleration Method: All disabled
  +
</PRE>
  +
  +
|-
  +
|
  +
  +
<PRE>
  +
dmesg -T
  +
</PRE>
  +
  +
<PRE>
  +
[Sun Sep 3 16:36:18 2023] hpsa 0000:09:00.0: scsi 6:0:2:0: masked Direct-Access HP EG0300FBLSE PHYS DRV SSDSmartPathCap- En- Exp=0
  +
[Mon Sep 4 08:48:25 2023] hpsa 0000:09:00.0: scsi 6:1:0:0: added Direct-Access HP LOGICAL VOLUME RAID-0 SSDSmartPathCap- En- Exp=1
  +
[Mon Sep 4 08:48:25 2023] scsi 6:1:0:0: Direct-Access HP LOGICAL VOLUME 6.64 PQ: 0 ANSI: 5
  +
[Mon Sep 4 08:48:25 2023] sd 6:1:0:0: [sdb] 585871964 512-byte logical blocks: (300 GB/279 GiB)
  +
[Mon Sep 4 08:48:25 2023] sd 6:1:0:0: [sdb] Write Protect is off
  +
[Mon Sep 4 08:48:25 2023] sd 6:1:0:0: [sdb] Mode Sense: 6b 00 00 08
  +
[Mon Sep 4 08:48:25 2023] sd 6:1:0:0: Attached scsi generic sg2 type 0
  +
[Mon Sep 4 08:48:25 2023] sd 6:1:0:0: [sdb] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
  +
[Mon Sep 4 08:48:25 2023] sd 6:1:0:0: [sdb] Attached SCSI disk
  +
</PRE>
  +
  +
||
  +
  +
<PRE>
  +
dmesg -T
  +
</PRE>
  +
  +
<PRE>
  +
[Thu Sep 7 12:07:02 2023] hpsa 0000:06:00.0: scsi 0:1:0:0: added Direct-Access HP LOGICAL VOLUME RAID-0 SSDSmartPathCap- En- Exp=1
  +
[Thu Sep 7 12:07:02 2023] scsi 0:1:0:0: Direct-Access HP LOGICAL VOLUME 6.30 PQ: 0 ANSI: 5
  +
[Thu Sep 7 12:07:02 2023] sd 0:1:0:0: [sda] 585871964 512-byte logical blocks: (300 GB/279 GiB)
  +
[Thu Sep 7 12:07:02 2023] sd 0:1:0:0: [sda] Write Protect is off
  +
[Thu Sep 7 12:07:02 2023] sd 0:1:0:0: [sda] Mode Sense: 73 00 00 08
  +
[Thu Sep 7 12:07:02 2023] sd 0:1:0:0: [sda] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
  +
[Thu Sep 7 12:07:02 2023] sd 0:1:0:0: [sda] Optimal transfer size 262144 bytes
  +
[Thu Sep 7 12:07:02 2023] sd 0:1:0:0: Attached scsi generic sg1 type 0
  +
[Thu Sep 7 12:07:02 2023] sd 0:1:0:0: [sda] Attached SCSI disk
  +
</PRE>
  +
  +
|}
  +
  +
=Обновление Firmware=
  +
Обнову скачать с сайта HP
  +
https://support.hpe.com/connect/s/search?language=en_US#q=hp%20h240&t=DriversandSoftware&sort=relevancy&numberOfResults=25
  +
<BR>
  +
Поиском искать по строке "HP H240"
  +
<BR>
  +
Пакет <code>rpm</code> можно не ставить а просто достать из него файлы (нужны rpm2cpio или rpm в убунте)<BR>
  +
Для <code>P410</code> уже был последний софт, так что не обновлял (но судя по документации процедура та же)
  +
  +
{| class="wikitable"
  +
|+ Firmware Update
  +
|-
  +
! <code>H240</code>
  +
|-
  +
|
  +
  +
<PRE>
  +
ssacli controller all show config detail | grep 'Firmware Version'
  +
Firmware Version: 6.30
  +
</PRE>
  +
  +
|-
  +
|
  +
  +
<PRE>
  +
cd /usr/lib/x86_64-linux-gnu/firmware-smartarray-ea3138d8e8-7.20-1.
  +
</PRE>
  +
<PRE>
  +
./setup
  +
</PRE>
  +
|-
  +
|
  +
  +
  +
  +
<PRE>
  +
Supplemental Update / Online ROM Flash Component for Linux (x64) - Smart Array and Smart HBA H240ar, H240nr, H240, H241, H244br, P240nr, P244br, P246br, P440ar, P440, P441, P542D, P741m, P840, P840ar, and P841 (7.20), searching...
  +
1) Smart HBA H240 in Slot 255 (6.30)
  +
Select which devices to flash [#,#-#,(A)ll,(N)one]> A
  +
Flashing Smart HBA H240 in Slot 255 [ 6.30 -> 7.20 ]
  +
Deferred flashes will be performed on next system reboot
  +
============ Summary ============
  +
Smart Component Finished
  +
  +
Summary Messages
  +
================
  +
Reboot needed to activate 1 new FW image
  +
  +
Exit Status: 1
  +
Deferred flashes will be performed on next system reboot
  +
A reboot is required to complete update.
  +
</PRE>
  +
|-
  +
|
  +
  +
<PRE>
  +
ssacli controller all show config detail | grep 'Firmware Version'
  +
Firmware Version: 7.20
  +
</PRE>
  +
|}
  +
  +
=<code>smartctl</code>=
  +
{| class="wikitable"
  +
|+ smartctl
  +
|-
  +
! <code>P410</code>!! <code>H240</code>
  +
|-
  +
|
  +
  +
* В части <code>-d cciss,0</code> 0 - это номер диска (а так как их в логическом устройстве всего один, то номер у него нулевой).<BR>
  +
Для более сложных рейдов будут доступны и другие значения.
  +
<BR>
  +
  +
<PRE>
  +
smartctl -x /dev/sdb -d cciss,0 --all
  +
</PRE>
  +
  +
||
  +
  +
* Так же хотя в системе виден только один диск (<code>/dev/sda</code>), прочитать SMART можно с любого из дисков, без добавления его в логическую
  +
группу, меняя значение <code>cciss,'''2'''</code>, в случае 3 дисков доступны значения 0,1,2 хотя имя устройства все время <code>/dev/sda</code>
  +
<PRE>
  +
smartctl -x /dev/sda -d cciss,2 --all
  +
</PRE>
  +
|-
  +
|
  +
  +
{{#spoiler:show=smartctl -x /dev/sdb -d cciss,0 --all|
  +
  +
<PRE>
  +
smartctl -x /dev/sdb -d cciss,0 --all
  +
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.0-58-generic] (local build)
  +
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org
  +
  +
=== START OF INFORMATION SECTION ===
  +
Vendor: HP
  +
Product: EG0300FBLSE
  +
Revision: HPD7
  +
Compliance: SPC-3
  +
User Capacity: 300,000,000,000 bytes [300 GB]
  +
Logical block size: 512 bytes
  +
Rotation Rate: 10000 rpm
  +
Form Factor: 2.5 inches
  +
Logical Unit id: 0x5000c5005fbbaa93
  +
Serial number: 6XP5CLK80000B335CPL7
  +
Device type: disk
  +
Transport protocol: SAS (SPL-3)
  +
Local Time is: Mon Sep 4 09:08:17 2023 UTC
  +
SMART support is: Available - device has SMART capability.
  +
SMART support is: Enabled
  +
Temperature Warning: Enabled
  +
Read Cache is: Enabled
  +
Writeback Cache is: Disabled
  +
  +
=== START OF READ SMART DATA SECTION ===
  +
SMART Health Status: OK
  +
  +
Current Drive Temperature: 29 C
  +
Drive Trip Temperature: 65 C
  +
  +
Manufactured in week 11 of year 2013
  +
Specified cycle count over device lifetime: 10000
  +
Accumulated start-stop cycles: 151
  +
Specified load-unload count over device lifetime: 300000
  +
Accumulated load-unload cycles: 3129
  +
Elements in grown defect list: 146
  +
  +
Error counter log:
  +
Errors Corrected by Total Correction Gigabytes Total
  +
ECC rereads/ errors algorithm processed uncorrected
  +
fast | delayed rewrites corrected invocations [10^9 bytes] errors
  +
read: 0 0 0 0 0 467758.919 0
  +
write: 0 0 0 2 0 44630.927 1
  +
  +
Non-medium error count: 23
  +
  +
No Self-tests have been logged
  +
  +
Background scan results log
  +
Status: waiting until BMS interval timer expires
  +
Accumulated power on time, hours:minutes 72101:55 [4326115 minutes]
  +
Number of background scans performed: 2819, scan progress: 0.00%
  +
Number of background medium scans performed: 2819
  +
  +
Protocol Specific port log page for SAS SSP
  +
relative target port id = 1
  +
generation code = 0
  +
number of phys = 1
  +
phy identifier = 0
  +
attached device type: SAS or SATA device
  +
attached reason: unknown
  +
reason: power on
  +
negotiated logical link rate: phy enabled; 6 Gbps
  +
attached initiator port: ssp=1 stp=1 smp=1
  +
attached target port: ssp=0 stp=0 smp=0
  +
SAS address = 0x5000c5005fbbaa91
  +
attached SAS address = 0x5001438006116c24
  +
attached phy identifier = 6
  +
Invalid DWORD count = 0
  +
Running disparity error count = 0
  +
Loss of DWORD synchronization = 0
  +
Phy reset problem = 0
  +
Phy event descriptors:
  +
Invalid word count: 0
  +
Running disparity error count: 0
  +
Loss of dword synchronization count: 0
  +
Phy reset problem count: 0
  +
relative target port id = 2
  +
generation code = 0
  +
number of phys = 1
  +
phy identifier = 1
  +
attached device type: no device attached
  +
attached reason: unknown
  +
reason: unknown
  +
negotiated logical link rate: phy enabled; 1.5 Gbps
  +
attached initiator port: ssp=0 stp=0 smp=0
  +
attached target port: ssp=0 stp=0 smp=0
  +
SAS address = 0x5000c5005fbbaa92
  +
attached SAS address = 0x0
  +
attached phy identifier = 0
  +
Invalid DWORD count = 0
  +
Running disparity error count = 0
  +
Loss of DWORD synchronization = 0
  +
Phy reset problem = 0
  +
Phy event descriptors:
  +
Invalid word count: 0
  +
Running disparity error count: 0
  +
Loss of dword synchronization count: 0
  +
Phy reset problem count: 0
 
</PRE>
  
</PRE>
 
}}
  
}}
   
  +
||
−
==1==
  
  +
  +
{{#spoiler:show=smartctl -x /dev/sdb -d cciss,0 --all|
  +
  +
<PRE>
  +
smartctl -x /dev/sda -d cciss,1 --all
  +
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.0-58-generic] (local build)
  +
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org
  +
  +
=== START OF INFORMATION SECTION ===
  +
Vendor: HP
  +
Product: EG0300FBLSE
  +
Revision: HPD7
  +
Compliance: SPC-3
  +
User Capacity: 300,000,000,000 bytes [300 GB]
  +
Logical block size: 512 bytes
  +
Rotation Rate: 10000 rpm
  +
Form Factor: 2.5 inches
  +
Logical Unit id: 0x5000c5005fbbaa93
  +
Serial number: 6XP5CLK80000B335CPL7
  +
Device type: disk
  +
Transport protocol: SAS (SPL-3)
  +
Local Time is: Thu Sep 7 12:23:42 2023 UTC
  +
SMART support is: Available - device has SMART capability.
  +
SMART support is: Enabled
  +
Temperature Warning: Enabled
  +
Read Cache is: Enabled
  +
Writeback Cache is: Enabled
  +
  +
=== START OF READ SMART DATA SECTION ===
  +
SMART Health Status: OK
  +
  +
Current Drive Temperature: 33 C
  +
Drive Trip Temperature: 65 C
  +
  +
Manufactured in week 11 of year 2013
  +
Specified cycle count over device lifetime: 10000
  +
Accumulated start-stop cycles: 154
  +
Specified load-unload count over device lifetime: 300000
  +
Accumulated load-unload cycles: 3134
  +
Elements in grown defect list: 146
  +
  +
Error counter log:
  +
Errors Corrected by Total Correction Gigabytes Total
  +
ECC rereads/ errors algorithm processed uncorrected
  +
fast | delayed rewrites corrected invocations [10^9 bytes] errors
  +
read: 0 0 0 0 0 467758.971 0
  +
write: 0 0 0 2 0 44646.161 1
  +
  +
Non-medium error count: 24
  +
  +
No Self-tests have been logged
  +
  +
Background scan results log
  +
Status: waiting until BMS interval timer expires
  +
Accumulated power on time, hours:minutes 72159:30 [4329570 minutes]
  +
Number of background scans performed: 2823, scan progress: 0.00%
  +
Number of background medium scans performed: 2823
  +
  +
Protocol Specific port log page for SAS SSP
  +
relative target port id = 1
  +
generation code = 0
  +
number of phys = 1
  +
phy identifier = 0
  +
attached device type: SAS or SATA device
  +
attached reason: unknown
  +
reason: hard reset
  +
negotiated logical link rate: phy enabled; 6 Gbps
  +
attached initiator port: ssp=1 stp=1 smp=1
  +
attached target port: ssp=0 stp=0 smp=0
  +
SAS address = 0x5000c5005fbbaa91
  +
attached SAS address = 0x5001438042ca2054
  +
attached phy identifier = 6
  +
Invalid DWORD count = 0
  +
Running disparity error count = 0
  +
Loss of DWORD synchronization = 2
  +
Phy reset problem = 0
  +
Phy event descriptors:
  +
Invalid word count: 0
  +
Running disparity error count: 0
  +
Loss of dword synchronization count: 2
  +
Phy reset problem count: 0
  +
relative target port id = 2
  +
generation code = 0
  +
number of phys = 1
  +
phy identifier = 1
  +
attached device type: no device attached
  +
attached reason: unknown
  +
reason: unknown
  +
negotiated logical link rate: phy enabled; 1.5 Gbps
  +
attached initiator port: ssp=0 stp=0 smp=0
  +
attached target port: ssp=0 stp=0 smp=0
  +
SAS address = 0x5000c5005fbbaa92
  +
attached SAS address = 0x0
  +
attached phy identifier = 0
  +
Invalid DWORD count = 0
  +
Running disparity error count = 0
  +
Loss of DWORD synchronization = 0
  +
Phy reset problem = 0
  +
Phy event descriptors:
  +
Invalid word count: 0
  +
Running disparity error count: 0
  +
Loss of dword synchronization count: 0
  +
Phy reset problem count: 0
  +
</PRE>
  +
}}
  +
  +
|}
  +
  +
=1=
  +
<PRE>
  +
hpssacli ctrl slot=0 ld 1 show status
  +
logicaldrive 1 (14.6 TB, 0): Failed
  +
Then we re-enable the logical drive:
  +
hpssacli ctrl slot=0 ld 1 modify reenable forced
  +
</PRE>
  +
  +
=Примеры из интерента которые не проверял=
  +
{{#spoiler:show=show|
  +
  +
  +
логический диск — чередование
  +
<PRE>
  +
hpacucli> ctrl slot=0 create type=ld drives=1:13,1:14 size=300 raid=1
  +
</PRE>
  +
логический диск — raid 5
  +
<PRE>
  +
hpacucli> ctrl slot=0 create type=ld drives=1:13,1:14,1:15,1:16,1:17 raid=5drives — конкретные диски, все диски (all drives) или неиспользуемые диски (unassigned drives)
  +
</PRE>
  +
size -размер логического диска в Мб
  +
raid — тип raid 0, 1 , 1+0 and 5
  +
  +
Удаление
  +
<PRE>
  +
hpacucli> ctrl slot=0 ld 4 delete
  +
</PRE>
  +
  +
Добавление дисков
  +
<PRE>
  +
hpacucli> ctrl slot=0 ld 4 add drives=2:3
  +
</PRE>
  +
  +
Добавление дискового пространства (принудительно)
  +
<PRE>
  +
hpacucli ctrl slot=0 ld 4 modify size=500 forced
  +
</PRE>
  +
Добавление резервного диска spare
  +
<PRE>
  +
hpacucli> ctrl slot=0 array all add spares=1:5,1:7
  +
</PRE>
  +
  +
  +
  +
  +
  +
  +
  +
}}

Текущая версия на 12:21, 10 апреля 2024


Raid на серверах HP

Мне достались 2 сервера с разными контроллерами

  • P410 с кешем и H240 без кеша
Контроллеры

P410

H240 

lspci  -s 09:00.0 -vv
09:00.0 RAID bus controller: Hewlett-Packard Company Smart Array G6 controllers (rev 01)
	Subsystem: Hewlett-Packard Company Smart Array P410

lspci  -s 06:00.0 -vv
06:00.0 RAID bus controller: Hewlett-Packard Company Smart Array Gen9 Controllers (rev 01)
	Subsystem: Hewlett-Packard Company H240

09:00.0 RAID bus controller: Hewlett-Packard Company Smart Array G6 controllers (rev 01)
	Subsystem: Hewlett-Packard Company Smart Array P410
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 256 bytes
	Interrupt: pin A routed to IRQ 37
	Region 0: Memory at fbc00000 (64-bit, non-prefetchable) [size=2M]
	Region 2: Memory at fbbff000 (64-bit, non-prefetchable) [size=4K]
	Region 4: I/O ports at d800 [size=256]
	Expansion ROM at fbb00000 [disabled] [size=512K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=375mA PME(D0+,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [70] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <1us, L1 <8us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
		DevCtl:	CorrErr- NonFatalErr+ FatalErr+ UnsupReq-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 256 bytes, MaxReadReq 4096 bytes
		DevSta:	CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 5GT/s, Width x8, ASPM not supported
			ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
		LnkCtl:	ASPM Disabled; RCB 64 bytes, Disabled- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s (ok), Width x8 (ok)
			TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+ NROPrPrP- LTR-
			 10BitTagComp- 10BitTagReq- OBFF Not Supported, ExtFmt- EETLPPrefix-
			 EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
			 FRS- TPHComp- ExtTPHComp-
			 AtomicOpsCap: 32bit- 64bit- 128bitCAS-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- OBFF Disabled,
			 AtomicOpsCtl: ReqEn-
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
			 EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
			 Retimer- 2Retimers- CrosslinkRes: unsupported
	Capabilities: [ac] MSI-X: Enable+ Count=16 Masked-
		Vector table: BAR=0 offset=001c2000
		PBA: BAR=0 offset=001c4000
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		AERCap:	First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
			MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
		HeaderLog: 00000000 00000000 00000000 00000000
	Kernel driver in use: hpsa
	Kernel modules: hpsa

 lspci  -s 06:00.0 -vv
06:00.0 RAID bus controller: Hewlett-Packard Company Smart Array Gen9 Controllers (rev 01)
	Subsystem: Hewlett-Packard Company H240
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 256 bytes
	Interrupt: pin A routed to IRQ 57
	Region 0: Memory at fbd00000 (64-bit, non-prefetchable) [size=1M]
	Region 2: Memory at fbcffc00 (64-bit, non-prefetchable) [size=1K]
	Region 4: I/O ports at d800 [size=256]
	Expansion ROM at fbc00000 [disabled] [size=512K]
	Capabilities: [80] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [90] MSI: Enable- Count=1/32 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [b0] MSI-X: Enable+ Count=64 Masked-
		Vector table: BAR=0 offset=00002000
		PBA: BAR=0 offset=00003000
	Capabilities: [c0] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 512 bytes, PhantFunc 0, Latency L0s <4us, L1 <1us
			ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
		DevCtl:	CorrErr- NonFatalErr+ FatalErr+ UnsupReq-
			RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 256 bytes, MaxReadReq 4096 bytes
		DevSta:	CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 8GT/s, Width x8, ASPM not supported
			ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp+
		LnkCtl:	ASPM Disabled; RCB 64 bytes, Disabled- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 5GT/s (downgraded), Width x8 (ok)
			TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range B, TimeoutDis+ NROPrPrP- LTR-
			 10BitTagComp- 10BitTagReq- OBFF Via message, ExtFmt- EETLPPrefix-
			 EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
			 FRS- TPHComp+ ExtTPHComp-
			 AtomicOpsCap: 32bit+ 64bit+ 128bitCAS+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- OBFF Disabled,
			 AtomicOpsCtl: ReqEn-
		LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
		LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
			 EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
			 Retimer- 2Retimers- CrosslinkRes: unsupported
	Capabilities: [100 v2] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt+ RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
		AERCap:	First Error Pointer: 00, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
			MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
		HeaderLog: 00000000 00000000 00000000 00000000
	Capabilities: [300 v1] Secondary PCI Express
		LnkCtl3: LnkEquIntrruptEn- PerformEqu-
		LaneErrStat: 0
	Kernel driver in use: hpsa
	Kernel modules: hpsa

Модуль ядра: hpsa

Модуль ядра: hpsa

Утилиты

Для обоих контроллеров можно использовать новую утилиту ssacli (Smart Storage Admin CLI),
которая заменяет более старые hpacucli и hpssacli, однако на момент
начала работы я этого не знал, и для P410 использовал более старую утилиту

Утилиты
Общее место где можно искать утилиты:

P410

H240

Файл:Hpacucli 9.40.1-1. amd64.deb 

wget https://downloads.linux.hpe.com/SDR/repo/mcp/ubuntu/pool/non-free/hpacucli_9.40.1-1._amd64.deb

Файл:Ssacli-6.15-11.0 amd64.deb 

wget https://downloads.linux.hpe.com/SDR/repo/mcp/ubuntu/pool/non-free/ssacli-6.15-11.0_amd64.deb


Сокращения, которые можно использовать в командах

  • chassisname = ch
  • controller = ctrl
  • logicaldrive = ld
  • physicaldrive = pd
  • drivewritecache = dwc

Просмотр конфигурации

Просмотр конфигурации
P410 ! H240 
hpacucli ctrl all show config detail

ssacli ctrl all show config detail

hpacucli ctrl all show config
Smart Array P410 in Slot 1                (sn: PACCR9SYRIHU  )
   unassigned
      physicaldrive 2I:1:3 (port 2I:box 1:bay 3, SAS, 300 GB, OK)
   SEP (Vendor ID PMCSIERA, Model  SRC 8x6G) 250 (WWID: 5001438006116C2F)

ssacli ctrl all show config

Smart HBA H240 in Slot 255 (RAID Mode)    (sn: PDNNK0BRHAE1PT)
   Port Name: 1I
   Port Name: 2I

Smart Array P410 in Slot 1
   Bus Interface: PCI
   Slot: 1
   Serial Number: PACCR9SYRIHU
   Cache Serial Number: PAAVP9SYYM4C
   RAID 6 (ADG) Status: Disabled
   Controller Status: OK
   Hardware Revision: C
   Firmware Version: 6.64
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: True
   Cache Status: Not Configured
   Drive Write Cache: Disabled
   Total Cache Size: 512 MB
   Total Cache Memory Available: 400 MB
   No-Battery Write Cache: Disabled
   Battery/Capacitor Count: 0
   SATA NCQ Supported: True



   unassigned

      physicaldrive 2I:1:3
         Port: 2I
         Box: 1
         Bay: 3
         Status: OK
         Drive Type: Unassigned Drive
         Interface Type: SAS
         Size: 300 GB
         Rotational Speed: 10000
         Firmware Revision: HPD7
         Serial Number: 6XP5CLK80000B335CPL7
         Model: HP      EG0300FBLSE
         PHY Count: 2
         PHY Transfer Rate: 6.0Gbps, Unknown


   SEP (Vendor ID PMCSIERA, Model  SRC 8x6G) 250
      Device Number: 250
      Firmware Version: RevC
      WWID: 5001438006116C2F
      Vendor ID: PMCSIERA
      Model:  SRC 8x6G

ssacli ctrl all show config detail

Smart HBA H240 in Slot 255 (RAID Mode)
   Bus Interface: PCI
   Slot: 255
   Serial Number: PDNNK0BRHAE1PT
   Cache Serial Number: PDNNK0BRHAE1PT
   Controller Status: OK
   Hardware Revision: B
   Firmware Version: 6.30
   Firmware Supports Online Firmware Activation: False
   Wait for Cache Room: Disabled
   Surface Analysis Inconsistency Notification: Disabled
   Post Prompt Timeout: 0 secs
   Cache Board Present: False
   Drive Write Cache: Disabled
   Controller Memory Size: 0.2
   SATA NCQ Supported: True
   Spare Activation Mode: Activate on physical drive failure (default)
   Controller Temperature (C): 33
   Number of Ports: 2 Internal only
   Encryption: Not Set
   Express Local Encryption: False
   Driver Name: hpsa
   Driver Version: 3.4.20
   WWN Port: 5001438042CA2050
   Driver Supports SSD Smart Path: True
   PCI Address (Domain:Bus:Device.Function): 0000:06:00.0
   Negotiated PCIe Data Rate: PCIe 2.0 x8 (4000 MB/s)
   Controller Mode: RAID Mode
   Pending Controller Mode: RAID
   Controller Mode Reboot: Not Required
   Port Max Phy Rate Limiting Supported: False
   Latency Scheduler Setting: Disabled
   Current Power Mode: MaxPerformance
   Survival Mode: Enabled
   Host Serial Number: 2M2812021S
   Sanitize Erase Supported: True
   Primary Boot Volume: Unknown (600508B1001C2F75860BC680F0767397)
   Secondary Boot Volume: Unknown (600508B1001C2F75860BC680F0767397)
   SPDM Supports Get Slot Certificate Chain: no
   SPDM Supports Get Controller Info       : no
   SPDM Supports Get Slot Info             : no
   SPDM Supports Set Import Certificate    : no
   SPDM Supports Set Invalidate Slot       : no
   Surface Scan Completion Supported: False
   Persistent Event Log Policy Change Supported: False

Тут не показаны подключенные диски так как их не было на момент написания


Статус контроллера

Статус контроллера
P410 H240 
hpacucli ctrl all show status

ssacli ctrl all show status

Smart Array P410 in Slot 1
   Controller Status: OK
   Cache Status: Not Configured


Smart HBA H240 in Slot 255 (RAID Mode)
   Controller Status: OK

Управление кэшированием

Управление кэшированием
P410 H240 
hpacucli ctrl slot=1 modify dwc=disable

Error: This operation is not supported with the current configuration. Use the
       "show" command on devices to show additional details about the
       configuration.
Reason: Controller not configured

ssacli controller slot=255 modify dwc=disable

hpacucli ctrl slot=1 modify dwc=enable

Warning: Without the proper safety precautions, use of write cache on physical
         drives could cause data loss in the event of power failure.  To ensure
         data is properly protected, use redundant power supplies and
         Uninterruptible Power Supplies. Also, if you have multiple storage
         enclosures, all data should be mirrored across them. Use of this
         feature is not recommended unless these precautions are followed.
         Continue? (y/n)

У меня не включился, думаю из-за 

   Battery/Capacitor Count: 0

ssacli controller slot=255 modify dwc=enable

Warning: Without the proper safety precautions, use of write cache on physical
         drives could cause data loss in the event of power failure.  To ensure
         data is properly protected, use redundant power supplies and
         Uninterruptible Power Supplies. Also, if you have multiple storage
         enclosures, all data should be mirrored across them. Use of this
         feature is not recommended unless these precautions are followed.
         Continue? (y/n) y

Без батареи но включилось: 

ssacli controller slot=255 show detail | grep 'Drive Write Cache'
   Drive Write Cache: Enabled

Пересканировать устройства

Пересканировать устройства, добавленные с момента последнего сканирования
P410 H240 
hpacucli rescandetects newly added devices since the last rescan

В моем случае ни к чему не привело - диск нашелся сам по себе 

ssacli rescan

Мне не помогло, изначально диски не видились, не ясно был ли плохо вставлен кабель или помогло отключение и включение питания (изначально диски были вставлены на-горячую)

Просмотр информации о дисках

Просмотр информации о дисках
P410 H240

Все диски: 

 hpacucli controller slot=1 pd all show status
   physicaldrive 2I:1:3 (port 2I:box 1:bay 3, 300 GB): OK

Все диски: 

ssacli controller slot=255 pd all show status

   physicaldrive 1I:0:7 (port 1I:box 0:bay 7, 300 GB): OK
   physicaldrive 1I:0:6 (port 1I:box 0:bay 6, 200 GB): OK
   physicaldrive 1I:0:8 (port 1I:box 0:bay 8, 300 GB): OK

hpacucli ctrl slot=1 pd 2I:1:3 show detail

ssacli controller slot=255 pd 1I:0:7 show detail

Smart Array P410 in Slot 1
   unassigned
      physicaldrive 2I:1:3
         Port: 2I
         Box: 1
         Bay: 3
         Status: OK
         Drive Type: Unassigned Drive
         Interface Type: SAS
         Size: 300 GB
         Rotational Speed: 10000
         Firmware Revision: HPD7
         Serial Number: 6XP5CLK80000B335CPL7
         Model: HP      EG0300FBLSE
         PHY Count: 2
         PHY Transfer Rate: 6.0Gbps, Unknown

Во многих примерах приводят pd 2:3 (2-х значный адрес)
вместо pd 2I:1:3 (3-х значный), возможно связано с версией контроллера или утилит. 

Smart HBA H240 in Slot 255
   Array A
      physicaldrive 1I:0:7
         Port: 1I
         Box: 0
         Bay: 7
         Status: OK
         Drive Type: Data Drive
         Interface Type: SAS
         Size: 300 GB
         Drive exposed to OS: False
         Logical/Physical Block Size: 512/512
         Rotational Speed: 10000
         Firmware Revision: HPD7
         Serial Number: 6XP5CLK80000B335CPL7
         WWID: 5000C5005FBBAA91
         Model: HP      EG0300FBLSE
         Current Temperature (C): 31
         Maximum Temperature (C): 58
         PHY Count: 2
         PHY Transfer Rate: 6.0Gbps, Unknown
         PHY Physical Link Rate: Unknown, Unknown
         PHY Maximum Link Rate: Unknown, Unknown
         Drive Authentication Status: Not Applicable
         Sanitize Erase Supported: False
         Shingled Magnetic Recording Support: None


Сам адрес диска, если он не известен можно посмотреть в hpacucli ctrl all show config detail
Часть вывода пропущена 

    physicaldrive 2I:1:3
         Port: 2I
         Box: 1
         Bay: 3

Сам адрес диска, если он не известен можно посмотреть в ssacli ctrl all show config detail
Часть вывода пропущена 

     physicaldrive 1I:0:7
         Port: 1I
         Box: 0
         Bay: 7

Очистка

Перед очисткой, если диск находится в логической группе, его нужно вывести или удалить группу, например так: 

ssacli ctrl slot=255 ld 1 delete
Очистка
P410 H240 
hpacucli ctrl slot=1 pd 2I:1:3 modify erase

ssacli ctrl slot=255 pd 1I:0:7 modify erase

После очистки нужно заново включить диск 

ssacli ctrl slot=255 pd 1I:0:7 modify enableeraseddrive

Управление диодами на дисках

Управление диодами на дисках
P410 H240 
hpacucli ctrl slot=1 pd 2I:1:3 modify led=on

ssacli ctrl slot=255 pd 1I:0:7 modify led=on

hpacucli ctrl slot=1 pd 2I:1:3 modify led=off

ssacli ctrl slot=255 pd 1I:0:7 modify led=off


Показать информацию (детально)

Показать информацию (детально)
P410 H240 
hpacucli ctrl slot=1 ld all show detail

Error: The specified device does not have any logical drives.

ssacli ctrl slot=255 ld all show detail

Error: The specified device does not have any logical drives.

Логических дисков пока нет

Создание дисков

Нельзя добавлять диски в процессе очистки, по-тому далее вместо 1I:0:7 использую 1I:0:8
Это видно например так (Erase In Progress) 

ssacli ctrl slot=255 pd all  show

Smart HBA H240 in Slot 255
   Unassigned
      physicaldrive 1I:0:6 (port 1I:box 0:bay 6, SATA SSD, 200 GB, OK)
      physicaldrive 1I:0:7 (port 1I:box 0:bay 7, SAS HDD, 300 GB, Erase In Progress)
      physicaldrive 1I:0:8 (port 1I:box 0:bay 8, SAS HDD, 300 GB, OK)
Создание дисков
P410 H240

логический диск (отдельный диск). Команда не возвращает вывод, результат смотреть отдельно. 

hpacucli ctrl slot=1 create type=ld drives=2I:1:3  raid=0

ssacli ctrl slot=255 create type=ld drives=1I:0:8  raid=0

Просмотреть что вышло? 

hpacucli ctrl slot=1 ld all show detail

Smart Array P410 in Slot 1

   array A

      Logical Drive: 1
         Size: 279.4 GB
         Fault Tolerance: 0
         Heads: 255
         Sectors Per Track: 32
         Cylinders: 65535
         Strip Size: 256 KB
         Full Stripe Size: 256 KB
         Status: OK
         Caching:  Enabled
         Unique Identifier: 600508B1001C8823B6E46FDAC58243EC
         Disk Name: /dev/sdb
         Mount Points: None
         Logical Drive Label: A7044617PACCR9SYRIHUC7C6
         Drive Type: Data

 ssacli ctrl slot=255 ld all show detail

Smart HBA H240 in Slot 255

   Array A

      Logical Drive: 1
         Size: 279.37 GB
         Fault Tolerance: 0
         Heads: 255
         Sectors Per Track: 32
         Cylinders: 65535
         Strip Size: 256 KB
         Full Stripe Size: 256 KB
         Status: OK
         MultiDomain Status: OK
         Caching:  Disabled
         Last Surface Scan Completed: False
         Unique Identifier: 600508B1001CE2A17D6A7F43F07AE289
         Disk Name: /dev/sda
         Mount Points: None
         Logical Drive Label: Logical Drive 1
         Drive Type: Data
         LD Acceleration Method: All disabled

dmesg -T

[Sun Sep  3 16:36:18 2023] hpsa 0000:09:00.0: scsi 6:0:2:0: masked Direct-Access     HP       EG0300FBLSE      PHYS DRV SSDSmartPathCap- En- Exp=0
[Mon Sep  4 08:48:25 2023] hpsa 0000:09:00.0: scsi 6:1:0:0: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap- En- Exp=1
[Mon Sep  4 08:48:25 2023] scsi 6:1:0:0: Direct-Access     HP       LOGICAL VOLUME   6.64 PQ: 0 ANSI: 5
[Mon Sep  4 08:48:25 2023] sd 6:1:0:0: [sdb] 585871964 512-byte logical blocks: (300 GB/279 GiB)
[Mon Sep  4 08:48:25 2023] sd 6:1:0:0: [sdb] Write Protect is off
[Mon Sep  4 08:48:25 2023] sd 6:1:0:0: [sdb] Mode Sense: 6b 00 00 08
[Mon Sep  4 08:48:25 2023] sd 6:1:0:0: Attached scsi generic sg2 type 0
[Mon Sep  4 08:48:25 2023] sd 6:1:0:0: [sdb] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[Mon Sep  4 08:48:25 2023] sd 6:1:0:0: [sdb] Attached SCSI disk

dmesg -T

[Thu Sep  7 12:07:02 2023] hpsa 0000:06:00.0: scsi 0:1:0:0: added Direct-Access     HP       LOGICAL VOLUME   RAID-0 SSDSmartPathCap- En- Exp=1
[Thu Sep  7 12:07:02 2023] scsi 0:1:0:0: Direct-Access     HP       LOGICAL VOLUME   6.30 PQ: 0 ANSI: 5
[Thu Sep  7 12:07:02 2023] sd 0:1:0:0: [sda] 585871964 512-byte logical blocks: (300 GB/279 GiB)
[Thu Sep  7 12:07:02 2023] sd 0:1:0:0: [sda] Write Protect is off
[Thu Sep  7 12:07:02 2023] sd 0:1:0:0: [sda] Mode Sense: 73 00 00 08
[Thu Sep  7 12:07:02 2023] sd 0:1:0:0: [sda] Write cache: disabled, read cache: disabled, doesn't support DPO or FUA
[Thu Sep  7 12:07:02 2023] sd 0:1:0:0: [sda] Optimal transfer size 262144 bytes
[Thu Sep  7 12:07:02 2023] sd 0:1:0:0: Attached scsi generic sg1 type 0
[Thu Sep  7 12:07:02 2023] sd 0:1:0:0: [sda] Attached SCSI disk

Обновление Firmware

Обнову скачать с сайта HP https://support.hpe.com/connect/s/search?language=en_US#q=hp%20h240&t=DriversandSoftware&sort=relevancy&numberOfResults=25
Поиском искать по строке "HP H240"
Пакет rpm можно не ставить а просто достать из него файлы (нужны rpm2cpio или rpm в убунте)
Для P410 уже был последний софт, так что не обновлял (но судя по документации процедура та же)

Firmware Update
H240 
ssacli controller all show config detail | grep 'Firmware Version'
   Firmware Version: 6.30

cd /usr/lib/x86_64-linux-gnu/firmware-smartarray-ea3138d8e8-7.20-1.

./setup



Supplemental Update / Online ROM Flash Component for Linux (x64) - Smart Array and Smart HBA H240ar, H240nr, H240, H241, H244br, P240nr, P244br, P246br, P440ar, P440, P441, P542D, P741m, P840, P840ar, and  P841 (7.20), searching...
1) Smart HBA H240 in Slot 255 (6.30)
Select which devices to flash [#,#-#,(A)ll,(N)one]> A
Flashing Smart HBA H240 in Slot 255 [ 6.30 -> 7.20 ]
Deferred flashes will be performed on next system reboot
============ Summary ============
Smart Component Finished

Summary Messages
================
Reboot needed to activate 1 new FW image

Exit Status: 1
Deferred flashes will be performed on next system reboot
A reboot is required to complete update.

ssacli controller all show config detail | grep 'Firmware Version'
   Firmware Version: 7.20

smartctl

smartctl
P410 H240
  • В части -d cciss,0 0 - это номер диска (а так как их в логическом устройстве всего один, то номер у него нулевой).

Для более сложных рейдов будут доступны и другие значения. 

smartctl -x /dev/sdb -d cciss,0 --all
  • Так же хотя в системе виден только один диск (/dev/sda), прочитать SMART можно с любого из дисков, без добавления его в логическую

группу, меняя значение cciss,2, в случае 3 дисков доступны значения 0,1,2 хотя имя устройства все время /dev/sda 

smartctl -x /dev/sda -d cciss,2 --all

1

hpssacli ctrl slot=0 ld 1 show status
logicaldrive 1 (14.6 TB, 0): Failed
Then we re-enable the logical drive:
hpssacli ctrl slot=0 ld 1 modify reenable forced

Примеры из интерента которые не проверял

Источник — https://noname.com.ua/mediawiki/index.php?title=HP_Proliant_Raid&oldid=13115