[Eisfair] E64 Inst (kvm) ohne netz

Kay Martinen kay at martinen.de
Do Jan 2 18:08:38 CET 2020


Am 02.01.2020 um 10:55 schrieb Hilmar Böhm:
> Hallo Kay,
> 
> Vielen Dank für Deine Anregung, mal unser KVM-Container-Setup bzgl NIC
> und Disk zu vergleichen (soweit das möglich ist).
> 
> Hier mein Setup:
> 
> 1. NIC
> Screenshot aus dem VirtManager:
> https://www.file-upload.net/download-13842827/Screen_eis643480vt_VirtMgr_vNIC.png.html
> (bitte rechten! Download-Button)
> 
> Ausschnitt zur NIC-Def. aus dem KVM-XML-File:
> --------------------
>     <interface type='bridge'>
>       <mac address='52:54:00:68:6d:42'/>
>       <source bridge='br0'/>
>       <model type='virtio'/>
>       <link state='up'/>
>       <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
> function='0x0'/>
>     </interface>
> --------------------
> 
> 2. Disk
> Screenshot aus dem VirtManager:
> https://www.file-upload.net/download-13842829/Screen_eis643480vt_VirtMgr_SCSI-vDISK.png.html
> 
> Ausschnitt zur Disk-Def. aus dem KVM-XML-File:
> --------------------
>     <disk type='file' device='disk'>
>       <driver name='qemu' type='qcow2' cache='writeback'/>
>       <source file='/datadisk2/eis643480vt_sys.qcow2'/>
>       <target dev='sda' bus='scsi'/>
>       <address type='drive' controller='0' bus='0' target='0'
> unit='0'/>
>     </disk>
> ..
>     <controller type='scsi' index='0' model='virtio-scsi'>
>       <address type='pci' domain='0x0000' bus='0x00' slot='0x07'
> function='0x0'/>
>     </controller>
> --------------------
> 
> Mich würde interessieren, ob es einen wesentlichen Unterschied gibt.

Hast du mal versucht den cache von writeback auf no zu stellen?

Hier ist mal die Ausgabe von 'info qtree' die; wie ich fand; am nahesten
dran ist an deinem output.

---snip---
# info qtree
bus: main-system-bus
  type System
  dev: hpet, id ""
    gpio-in "" 2
    gpio-out "" 1
    gpio-out "sysbus-irq" 32
    timers = 3 (0x3)
    msi = false
    hpet-intcap = 4 (0x4)
    hpet-offset-saved = true
    mmio 00000000fed00000/0000000000000400
  dev: kvm-ioapic, id ""
    gpio-in "" 24
    gsi_base = 0 (0x0)
    mmio 00000000fec00000/0000000000001000
  dev: i440FX-pcihost, id ""
    pci-hole64-size = 2147483648 (2 GiB)
    short_root_bus = 0 (0x0)
    x-pci-hole64-fix = true
    bus: pci.0
      type PCI
      dev: virtio-net-pci, id "net0"
        ioeventfd = true
        vectors = 3 (0x3)
        virtio-pci-bus-master-bug-migration = false
        disable-legacy = "off"
        disable-modern = false
        migrate-extra = true
        modern-pio-notify = false
        x-disable-pcie = false
        page-per-vq = false
        x-ignore-backend-features = false
        ats = false
        x-pcie-deverr-init = true
        x-pcie-lnkctl-init = true
        x-pcie-pm-init = true
        addr = 12.0
        romfile = "efi-virtio.rom"
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class Ethernet controller, addr 00:12.0, pci id 1af4:1000 (sub
1af4:0001)
        bar 0: i/o at 0xe060 [0xe07f]
        bar 1: mem at 0xfea52000 [0xfea52fff]
        bar 4: mem at 0xfe404000 [0xfe407fff]
        bar 6: mem at 0xffffffffffffffff [0x3fffe]
        bus: virtio-bus
          type virtio-pci-bus
          dev: virtio-net-device, id ""
            csum = true
            guest_csum = true
            gso = true
            guest_tso4 = true
            guest_tso6 = true
            guest_ecn = true
            guest_ufo = true
            guest_announce = true
            host_tso4 = true
            host_tso6 = true
            host_ecn = true
            host_ufo = true
            mrg_rxbuf = true
            status = true
            ctrl_vq = true
            ctrl_rx = true
            ctrl_vlan = true
            ctrl_rx_extra = true
            ctrl_mac_addr = true
            ctrl_guest_offloads = true
            mq = false
            mac = "b2:f1:c9:51:bd:7b"
            vlan = <null>
            netdev = "net0"
            x-txtimer = 150000 (0x249f0)
            x-txburst = 256 (0x100)
            tx = ""
            rx_queue_size = 256 (0x100)
            tx_queue_size = 256 (0x100)
            host_mtu = 0 (0x0)
            x-mtu-bypass-backend = true
            speed = -1 (0xffffffffffffffff)
            duplex = ""
            indirect_desc = true
            event_idx = true
            notify_on_empty = true
            any_layout = true
            iommu_platform = false
      dev: virtio-scsi-pci, id "scsihw0"
        ioeventfd = true
        vectors = 4 (0x4)
        virtio-pci-bus-master-bug-migration = false
        disable-legacy = "off"
        disable-modern = false
        migrate-extra = true
        modern-pio-notify = false
        x-disable-pcie = false
        page-per-vq = false
        x-ignore-backend-features = false
        ats = false
        x-pcie-deverr-init = true
        x-pcie-lnkctl-init = true
        x-pcie-pm-init = true
        addr = 05.0
        romfile = ""
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class SCSI controller, addr 00:05.0, pci id 1af4:1004 (sub
1af4:0008)
        bar 0: i/o at 0xe000 [0xe03f]
        bar 1: mem at 0xfea51000 [0xfea51fff]
        bar 4: mem at 0xfe400000 [0xfe403fff]
        bus: virtio-bus
          type virtio-pci-bus
          dev: virtio-scsi-device, id ""
            num_queues = 1 (0x1)
            virtqueue_size = 128 (0x80)
            max_sectors = 65535 (0xffff)
            cmd_per_lun = 128 (0x80)
            hotplug = true
            param_change = true
            iothread = ""
            indirect_desc = true
            event_idx = true
            notify_on_empty = true
            any_layout = true
            iommu_platform = false
            bus: scsihw0.0
              type SCSI
              dev: scsi-hd, id "scsi0"
                drive = "drive-scsi0"
                logical_block_size = 512 (0x200)
                physical_block_size = 512 (0x200)
                min_io_size = 0 (0x0)
                opt_io_size = 0 (0x0)
                discard_granularity = 4096 (0x1000)
                write-cache = "auto"
                share-rw = false
                rerror = "auto"
                werror = "auto"
                ver = "2.5+"
                serial = ""
                vendor = "QEMU"
                product = "QEMU HARDDISK"
                removable = false
                dpofua = false
                wwn = 0 (0x0)
                port_wwn = 0 (0x0)
                port_index = 0 (0x0)
                max_unmap_size = 1073741824 (0x40000000)
                max_io_size = 2147483647 (0x7fffffff)
                rotation_rate = 0 (0x0)
                scsi_version = 5 (0x5)
                cyls = 4161 (0x1041)
                heads = 16 (0x10)
                secs = 63 (0x3f)
                channel = 0 (0x0)
                scsi-id = 0 (0x0)
                lun = 0 (0x0)
      dev: VGA, id "vga"
        vgamem_mb = 16 (0x10)
        mmio = true
        qemu-extended-regs = true
        addr = 02.0
        romfile = "vgabios-stdvga.bin"
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class VGA controller, addr 00:02.0, pci id 1234:1111 (sub 1af4:1100)
        bar 0: mem at 0xfd000000 [0xfdffffff]
        bar 2: mem at 0xfea50000 [0xfea50fff]
        bar 6: mem at 0xffffffffffffffff [0xfffe]
      dev: piix3-usb-uhci, id "uhci"
        bandwidth = 1280 (0x500)
        maxframes = 128 (0x80)
        addr = 01.2
        romfile = ""
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class USB controller, addr 00:01.2, pci id 8086:7020 (sub 1af4:1100)
        bar 4: i/o at 0xe040 [0xe05f]
        bus: uhci.0
          type usb-bus
      dev: pci-bridge, id "pci.2"
        chassis_nr = 2 (0x2)
        msi = "auto"
        shpc = true
        addr = 1f.0
        romfile = ""
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class PCI bridge, addr 00:1f.0, pci id 1b36:0001 (sub 0000:0000)
        bar 0: mem at 0xfea54000 [0xfea540ff]
        bus: pci.2
          type PCI
      dev: pci-bridge, id "pci.1"
        chassis_nr = 1 (0x1)
        msi = "auto"
        shpc = true
        addr = 1e.0
        romfile = ""
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class PCI bridge, addr 00:1e.0, pci id 1b36:0001 (sub 0000:0000)
        bar 0: mem at 0xfea53000 [0xfea530ff]
        bus: pci.1
          type PCI
      dev: PIIX4_PM, id ""
        smb_io_base = 1792 (0x700)
        disable_s3 = 0 (0x0)
        disable_s4 = 0 (0x0)
        s4_val = 2 (0x2)
        acpi-pci-hotplug-with-bridge-support = true
        memory-hotplug-support = true
        addr = 01.3
        romfile = ""
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class Bridge, addr 00:01.3, pci id 8086:7113 (sub 1af4:1100)
        bus: i2c
          type i2c-bus
          dev: smbus-eeprom, id ""
            address = 87 (0x57)
          dev: smbus-eeprom, id ""
            address = 86 (0x56)
          dev: smbus-eeprom, id ""
            address = 85 (0x55)
          dev: smbus-eeprom, id ""
            address = 84 (0x54)
          dev: smbus-eeprom, id ""
            address = 83 (0x53)
          dev: smbus-eeprom, id ""
            address = 82 (0x52)
          dev: smbus-eeprom, id ""
            address = 81 (0x51)
          dev: smbus-eeprom, id ""
            address = 80 (0x50)
      dev: piix3-ide, id ""
        addr = 01.1
        romfile = ""
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class IDE controller, addr 00:01.1, pci id 8086:7010 (sub 1af4:1100)
        bar 4: i/o at 0xe080 [0xe08f]
        bus: ide.1
          type IDE
          dev: ide-cd, id "ide2"
            drive = "drive-ide2"
            logical_block_size = 512 (0x200)
            physical_block_size = 512 (0x200)
            min_io_size = 0 (0x0)
            opt_io_size = 0 (0x0)
            discard_granularity = 512 (0x200)
            write-cache = "auto"
            share-rw = false
            rerror = "auto"
            werror = "auto"
            ver = "2.5+"
            wwn = 0 (0x0)
            serial = "QM00003"
            model = ""
            unit = 0 (0x0)
        bus: ide.0
          type IDE
      dev: PIIX3, id ""
        addr = 01.0
        romfile = ""
        rombar = 1 (0x1)
        multifunction = true
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class ISA bridge, addr 00:01.0, pci id 8086:7000 (sub 1af4:1100)
        bus: isa.0
          type ISA
          dev: port92, id ""
            gpio-out "a20" 1
          dev: vmmouse, id ""
          dev: vmport, id ""
          dev: i8042, id ""
            gpio-out "a20" 1
            isa irqs 1,12
          dev: isa-fdc, id ""
            iobase = 1008 (0x3f0)
            irq = 6 (0x6)
            dma = 2 (0x2)
            driveA = ""
            driveB = ""
            check_media_rate = true
            fdtypeA = "auto"
            fdtypeB = "auto"
            fallback = "288"
            isa irq 6
            bus: floppy-bus.0
              type floppy-bus
          dev: i8257, id ""
            base = 192 (0xc0)
            page-base = 136 (0x88)
            pageh-base = -1 (0xffffffffffffffff)
            dshift = 1 (0x1)
          dev: i8257, id ""
            base = 0 (0x0)
            page-base = 128 (0x80)
            pageh-base = -1 (0xffffffffffffffff)
            dshift = 0 (0x0)
          dev: isa-pcspk, id ""
            iobase = 97 (0x61)
            migrate = true
          dev: kvm-pit, id ""
            gpio-in "" 1
            iobase = 64 (0x40)
            lost_tick_policy = "delay"
          dev: mc146818rtc, id ""
            gpio-out "" 1
            base_year = 0 (0x0)
            lost_tick_policy = "discard"
          dev: kvm-i8259, id ""
            iobase = 160 (0xa0)
            elcr_addr = 1233 (0x4d1)
            elcr_mask = 222 (0xde)
            master = false
          dev: kvm-i8259, id ""
            iobase = 32 (0x20)
            elcr_addr = 1232 (0x4d0)
            elcr_mask = 248 (0xf8)
            master = true
      dev: i440FX, id ""
        addr = 00.0
        romfile = ""
        rombar = 1 (0x1)
        multifunction = false
        command_serr_enable = true
        x-pcie-lnksta-dllla = true
        x-pcie-extcap-init = true
        class Host bridge, addr 00:00.0, pci id 8086:1237 (sub 1af4:1100)
  dev: fw_cfg_io, id ""
    dma_enabled = true
    x-file-slots = 32 (0x20)
  dev: kvmclock, id ""
    x-mach-use-reliable-get-clock = true
  dev: kvmvapic, id ""
---snap---

Das ist; so weit ich das sehe; die Komplette Hardware-abstraktion der
hier laufenden Eisfair-64 VM. Der output stammt aus dem 'monitor' tab in
der WebUI von ProxmoxVE 5.3.8 Die VM hat IMHO beim Installieren keine
Zicken gemacht, hatte aber auch gleich LAN und Disk und auf der hab ich
die Devel-pakete installiert um mir einen 64-bit gkrellmd zu bauen. Die
läuft auch schon ein paar Tage.

IN der VM siehts dann so aus:

--snip--
> Welcome to eisfair!
> base     : 2.8.23
> eiskernel: 4.9.196-eisfair-64-VIRT
> 
> Eisdevel64 # lspci -v
> 00:00.0 Host bridge: Intel Corporation 440FX - 82441FX PMC [Natoma] (rev 02)
>         Subsystem: Red Hat, Inc. Qemu virtual machine
>         Flags: fast devsel
> 
> 00:01.0 ISA bridge: Intel Corporation 82371SB PIIX3 ISA [Natoma/Triton II]
>         Subsystem: Red Hat, Inc. Qemu virtual machine
>         Flags: medium devsel
> 
> 00:01.1 IDE interface: Intel Corporation 82371SB PIIX3 IDE [Natoma/Triton II] (prog-if 80 [ISA Compatibility mode-only controller, supports bus mastering])
>         Subsystem: Red Hat, Inc. Qemu virtual machine
>         Flags: bus master, medium devsel, latency 0
>         [virtual] Memory at 000001f0 (32-bit, non-prefetchable) [size=8]
>         [virtual] Memory at 000003f0 (type 3, non-prefetchable)
>         [virtual] Memory at 00000170 (32-bit, non-prefetchable) [size=8]
>         [virtual] Memory at 00000370 (type 3, non-prefetchable)
>         I/O ports at e080 [size=16]
>         Kernel driver in use: ata_piix
>         Kernel modules: ata_piix, pata_acpi, ata_generic
> 
> 00:01.2 USB controller: Intel Corporation 82371SB PIIX3 USB [Natoma/Triton II] (rev 01) (prog-if 00 [UHCI])
>         Subsystem: Red Hat, Inc. QEMU Virtual Machine
>         Flags: bus master, fast devsel, latency 0, IRQ 11
>         I/O ports at e040 [size=32]
>         Kernel driver in use: uhci_hcd
>         Kernel modules: uhci_hcd
> 
> 00:01.3 Bridge: Intel Corporation 82371AB/EB/MB PIIX4 ACPI (rev 03)
>         Subsystem: Red Hat, Inc. Qemu virtual machine
>         Flags: medium devsel, IRQ 9
>         Kernel driver in use: piix4_smbus
>         Kernel modules: i2c_piix4
> 
> 00:02.0 VGA compatible controller: Device 1234:1111 (rev 02) (prog-if 00 [VGA controller])
>         Subsystem: Red Hat, Inc. Device 1100
>         Flags: fast devsel
>         Memory at fd000000 (32-bit, prefetchable) [size=16M]
>         Memory at fea50000 (32-bit, non-prefetchable) [size=4K]
>         Expansion ROM at 000c0000 [disabled] [size=128K]
> 
> 00:05.0 SCSI storage controller: Red Hat, Inc. Virtio SCSI
>         Subsystem: Red Hat, Inc. Virtio SCSI
>         Flags: bus master, fast devsel, latency 0, IRQ 10
>         I/O ports at e000 [size=64]
>         Memory at fea51000 (32-bit, non-prefetchable) [size=4K]
>         Memory at fe400000 (64-bit, prefetchable) [size=16K]
>         Capabilities: [98] MSI-X: Enable+ Count=4 Masked-
>         Capabilities: [84] Vendor Specific Information: VirtIO: <unknown>
>         Capabilities: [70] Vendor Specific Information: VirtIO: Notify
>         Capabilities: [60] Vendor Specific Information: VirtIO: DeviceCfg
>         Capabilities: [50] Vendor Specific Information: VirtIO: ISR
>         Capabilities: [40] Vendor Specific Information: VirtIO: CommonCfg
>         Kernel driver in use: virtio-pci
> 
> 00:12.0 Ethernet controller: Red Hat, Inc. Virtio network device
>         Subsystem: Red Hat, Inc. Virtio network device
>         Flags: bus master, fast devsel, latency 0, IRQ 10
>         I/O ports at e060 [size=32]
>         Memory at fea52000 (32-bit, non-prefetchable) [size=4K]
>         Memory at fe404000 (64-bit, prefetchable) [size=16K]
>         Expansion ROM at fea00000 [disabled] [size=256K]
>         Capabilities: [98] MSI-X: Enable+ Count=3 Masked-
>         Capabilities: [84] Vendor Specific Information: VirtIO: <unknown>
>         Capabilities: [70] Vendor Specific Information: VirtIO: Notify
>         Capabilities: [60] Vendor Specific Information: VirtIO: DeviceCfg
>         Capabilities: [50] Vendor Specific Information: VirtIO: ISR
>         Capabilities: [40] Vendor Specific Information: VirtIO: CommonCfg
>         Kernel driver in use: virtio-pci
> 
> 00:1e.0 PCI bridge: Red Hat, Inc. QEMU PCI-PCI bridge (prog-if 00 [Normal decode])
>         Flags: 66MHz, fast devsel, IRQ 10
>         Memory at fea53000 (64-bit, non-prefetchable) [size=256]
>         Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
>         I/O behind bridge: 0000d000-0000dfff [size=4K]
>         Memory behind bridge: fe800000-fe9fffff [size=2M]
>         Prefetchable memory behind bridge: 00000000fe200000-00000000fe3fffff [size=2M]
>         Capabilities: [4c] MSI: Enable- Count=1/1 Maskable+ 64bit+
>         Capabilities: [48] Slot ID: 0 slots, First+, chassis 01
>         Capabilities: [40] Hot-plug capable
> 
> 00:1f.0 PCI bridge: Red Hat, Inc. QEMU PCI-PCI bridge (prog-if 00 [Normal decode])
>         Flags: 66MHz, fast devsel, IRQ 11
>         Memory at fea54000 (64-bit, non-prefetchable) [size=256]
>         Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
>         I/O behind bridge: 0000c000-0000cfff [size=4K]
>         Memory behind bridge: fe600000-fe7fffff [size=2M]
>         Prefetchable memory behind bridge: 00000000fe000000-00000000fe1fffff [size=2M]
>         Capabilities: [4c] MSI: Enable- Count=1/1 Maskable+ 64bit+
>         Capabilities: [48] Slot ID: 0 slots, First+, chassis 02
>         Capabilities: [40] Hot-plug capable
> Eisdevel64 # lsscsi  -v
> [0:0:0:0]    disk    QEMU     QEMU HARDDISK    2.5+  /dev/sda
>   dir: /sys/bus/scsi/devices/0:0:0:0  [/sys/devices/pci0000:00/0000:00:05.0/virtio0/host0/target0:0:0/0:0:0:0]
> [2:0:0:0]    cd/dvd  QEMU     QEMU DVD-ROM     2.5+  /dev/sr0
>   dir: /sys/bus/scsi/devices/2:0:0:0  [/sys/devices/pci0000:00/0000:00:01.1/ata2/host2/target2:0:0/2:0:0:0]

--snap--


> Ansonsten bin ich immer noch der Meinung, dass ein nicht aktiver Link
> State der NIC nicht zu einem "no disk" Abbruch führen darf und dass das
> Problem im Installationsskript liegt.

Hab ich auch mal vermutet und glaubte ich könne das reproduzieren aber
dann doch nicht. Du benutzt ebenso KVM wie qemu wenn ich das recht sehe
(also wie Proxmox auch) und da vermute ich den unterschied eher in
deinem Disk-Setup.

Du hattest doch gesagt die Disk würde in der VM erst erkannt und dann
nicht mehr. Hast du ein Photo von dieser Ersten Erkennung/Meldung?

Bei mir ist es auch ein qcow2 container, aber 2 GB statt 5 und es ist
für scsi0 kein cache aktiviert. Der container selbst liegt auf einem
HW-Raid obwohl das allein keinen unterschied machen sollte.

Kay

-- 
Sent via SN (Eisfair-1)


Mehr Informationen über die Mailingliste Eisfair