KVM-Autotest/TODO: Difference between revisions

From KVM
No edit summary
No edit summary
Line 15: Line 15:


=== TODO ===
=== TODO ===
* Generate autotest API documentation with tools such as doxygen
* Hotplug tests during migration
* Work on setting up the conmux server for our internal test grid
* Research how to trigger jobs based on events rather than using the web interface setting recurrent jobs
* Set up a qemu-block job, with kwolf's qemu-block tree
* Set up a vhost job, with the upstream job (mst's trees for kernel and userspace)
* Add a BLOCKED status on the autotest database, that tells the user that some feature testing was left out due to a problem on its dependencies.
* Eventually get rid of all dependency on slirp/userspace networking to do any feature testing, since it is not a supported feature. Slipstreaming the kickstart in the install CD is a possibility, and it ends up being simpler than configuring an internal network thing for testing.
* Make it possible to install virtio nw driver under windows xp/2003 guests without having to resort to the msi installer


=== Done ===
=== Done ===
* Infrastructure for testing different vm storage backends: file/lvm/iSCSI - Done by Beijing team
* Made some internal patches appropriate for upstream
* Copy kvm-autotest@redhat.com on the email list of results
* Send code to retrieve host kernels based on koji/brew tags upstream
* Resolved UUID mount point check problem
* QMP suite integrated upstream
* Wrote code to retrieve kernels based on koji/brew tags


== mgoldish ==
== mgoldish ==
Line 43: Line 25:


=== done ===
=== done ===
* Post-commit review of new network patches (committed on Oct 7 2010)
* Use more exceptions in utility functions:
** Add convenience functions to kvm_subprocess.py to make running shell commands shorter
** Add convenience functions to the VM class
* Refactor _get_command_output() and friends in kvm_monitor.py and add cmd_raw(), cmd_obj() and cmd_qmp() as required by Luiz Capitulino's test suite
* Use select() instead of sleep() in kvm_monitor.py
* Simplify migration code if possible (in kvm_vm.py and kvm_test_utils.py)
* Fix VM.get_ifname() somehow (uses self.vnc_port -- bad)


== akong ==
== akong ==


* push redhat internal kvm subtests(more than 18) to upstream
* push redhat internal kvm subtests(more than 18) to upstream
''trans_hugepage_defrag.py trans_hugepage.py trans_hugepage_swapping.py hdparm.py cpuflags.py multi_disk.py nmi_watchdog.py qmp_command.py qmp_event_notification.py cdrom.py fillup_disk.py floppy.py format_disk.py lvm.py  usb.py ... ''[doing..]
''hdparm.py cpuflags.py multi_disk.py nmi_watchdog.py qmp_command.py qmp_event_notification.py cdrom.py fillup_disk.py floppy.py format_disk.py lvm.py  usb.py ... ''[doing..]
stop_continue.py[review..]
stop_continue.py[review..]
image_copy.py module_probe.py[done]
image_copy.py module_probe.py[done]
* Using dnsmasq in unattended_install to replace userspace network with private bridge [sent v2]
* Add a new test: check if guest transmits packets when link is up/down [done]
* Report problem with multiple NICs and MAC address tracking [problem fixed]
* review and test michael's whql patchsets, give feedback to michael [done]
* Bonding test [done]


== jason ==
== jason ==


* Tests in parallel with migration (reboot/unattended installation/file transfer/ autotest client tests / guest_script,autoit? / memtest86+(steps?)), need modifications to framework?
* Refactor the network cmdline generation, using peer when possible and vlan for elder qemu-kvm
* Port network tests into windows
* Port network tests into windows
* Profiler of pidstat
* Profiler of pidstat
* guest->guest guest->host netperf support
* guest->guest guest->host netperf support
* More readable test result of netperf
* More readable test result of netperf
=== done ===
* Migration to exec test suggested by mst
* Clean the Migration tests: mainly for exec and add offline support
* Write a 'cli' wrapper to make autotest handy/easier for developers
* Refactor hotplug test using qdev and netdev_del/drive_del


== yolkfull ==
== yolkfull ==
Line 104: Line 61:
== Cleber ==
== Cleber ==


=== done ===
* Look and fix the block_hotplug test upstream
* Integrate Brew/Koji messaging with automatic job submission - done with messagebusd plugin
* Create initscripts for the scheduller daemon (monitor_db_babysitter) - done with effort by autoqa project
* Revisit job parameterization to ease job submission - done with simple templating, cartesian config override and site extension


== Bugs ==
== Bugs ==


* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]
* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]

Revision as of 23:22, 28 June 2011

KVM-Autotest TODO list

raw idea

  • more vhost_net test
  • Add Multi-guests transfer test
  • transfer test between guest(s) and extra boxs
  • add more whql tests (virtio_net,virtio_blk)

general

Note: This session is for major, multi-person items. We'll update the status weekly based on the status of the subtasks attributed to persons.

lmr

TODO

Done

mgoldish

  • Make WHQL tests run on our internal server
  • Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it)
    • This may just be a matter of moving useful code from tests to kvm_test_utils.py to make it reusable

done

akong

  • push redhat internal kvm subtests(more than 18) to upstream

hdparm.py cpuflags.py multi_disk.py nmi_watchdog.py qmp_command.py qmp_event_notification.py cdrom.py fillup_disk.py floppy.py format_disk.py lvm.py usb.py ... [doing..] stop_continue.py[review..] image_copy.py module_probe.py[done]

jason

  • Port network tests into windows
  • Profiler of pidstat
  • guest->guest guest->host netperf support
  • More readable test result of netperf

yolkfull

  • Run netperf test between two guests
  • Migration with/without workload(dbench,lmbench etc)
  • Verify SMBIOS/DMI data (UUID, for example)
  • Disk serial number (for IDE, SCSI, VirtIO drives)

Beijing QE

  • pxe boot * net types
  • Further migration
  • Multiple nics
  • multiple disks
  • Test block device cancellation path using device mapper to generate errors ( after we had a crash in de_write_dma_cb)
  • Extend pci_assignable to support other PCI devices (USB, video cards, TV card etc)
  • Different CPU flags support
  • Passthrough the perf keys of run_autotest to autotest server
  • Register the virtual machine into autotest server and run benchmark through autotest server

Cleber

Bugs