From KVM
Line 15: Line 15:
  
 
=== TODO ===
 
=== TODO ===
 
* Generate autotest API documentation with tools such as doxygen
 
* Hotplug tests during migration
 
* Work on setting up the conmux server for our internal test grid
 
* Research how to trigger jobs based on events rather than using the web interface setting recurrent jobs
 
* Set up a qemu-block job, with kwolf's qemu-block tree
 
* Set up a vhost job, with the upstream job (mst's trees for kernel and userspace)
 
* Add a BLOCKED status on the autotest database, that tells the user that some feature testing was left out due to a problem on its dependencies.
 
* Eventually get rid of all dependency on slirp/userspace networking to do any feature testing, since it is not a supported feature. Slipstreaming the kickstart in the install CD is a possibility, and it ends up being simpler than configuring an internal network thing for testing.
 
* Make it possible to install virtio nw driver under windows xp/2003 guests without having to resort to the msi installer
 
  
 
=== Done ===
 
=== Done ===
 
* Infrastructure for testing different vm storage backends: file/lvm/iSCSI - Done by Beijing team
 
* Made some internal patches appropriate for upstream
 
* Copy kvm-autotest@redhat.com on the email list of results
 
* Send code to retrieve host kernels based on koji/brew tags upstream
 
* Resolved UUID mount point check problem
 
* QMP suite integrated upstream
 
* Wrote code to retrieve kernels based on koji/brew tags
 
  
 
== mgoldish ==
 
== mgoldish ==
Line 43: Line 25:
  
 
=== done ===
 
=== done ===
 
* Post-commit review of new network patches (committed on Oct 7 2010)
 
* Use more exceptions in utility functions:
 
** Add convenience functions to kvm_subprocess.py to make running shell commands shorter
 
** Add convenience functions to the VM class
 
* Refactor _get_command_output() and friends in kvm_monitor.py and add cmd_raw(), cmd_obj() and cmd_qmp() as required by Luiz Capitulino's test suite
 
* Use select() instead of sleep() in kvm_monitor.py
 
* Simplify migration code if possible (in kvm_vm.py and kvm_test_utils.py)
 
* Fix VM.get_ifname() somehow (uses self.vnc_port -- bad)
 
  
 
== akong ==
 
== akong ==
 
  
 
* push redhat internal kvm subtests(more than 18) to upstream
 
* push redhat internal kvm subtests(more than 18) to upstream
''trans_hugepage_defrag.py trans_hugepage.py trans_hugepage_swapping.py hdparm.py cpuflags.py multi_disk.py nmi_watchdog.py qmp_command.py qmp_event_notification.py cdrom.py fillup_disk.py floppy.py format_disk.py lvm.py  usb.py ... ''[doing..]
+
''hdparm.py cpuflags.py multi_disk.py nmi_watchdog.py qmp_command.py qmp_event_notification.py cdrom.py fillup_disk.py floppy.py format_disk.py lvm.py  usb.py ... ''[doing..]
 
stop_continue.py[review..]
 
stop_continue.py[review..]
 
image_copy.py module_probe.py[done]
 
image_copy.py module_probe.py[done]
 
* Using dnsmasq in unattended_install to replace userspace network with private bridge [sent v2]
 
* Add a new test: check if guest transmits packets when link is up/down [done]
 
* Report problem with multiple NICs and MAC address tracking [problem fixed]
 
* review and test michael's whql patchsets, give feedback to michael [done]
 
* Bonding test [done]
 
  
 
== jason ==
 
== jason ==
  
* Tests in parallel with migration (reboot/unattended installation/file transfer/ autotest client tests / guest_script,autoit? / memtest86+(steps?)), need modifications to framework?
 
* Refactor the network cmdline generation, using peer when possible and vlan for elder qemu-kvm
 
 
* Port network tests into windows
 
* Port network tests into windows
 
* Profiler of pidstat
 
* Profiler of pidstat
 
* guest->guest guest->host netperf support
 
* guest->guest guest->host netperf support
 
* More readable test result of netperf
 
* More readable test result of netperf
 
=== done ===
 
* Migration to exec test suggested by mst
 
* Clean the Migration tests: mainly for exec and add offline support
 
* Write a 'cli' wrapper to make autotest handy/easier for developers
 
* Refactor hotplug test using qdev and netdev_del/drive_del
 
 
  
 
== yolkfull ==
 
== yolkfull ==
Line 104: Line 61:
 
== Cleber ==
 
== Cleber ==
  
 
=== done ===
 
 
* Look and fix the block_hotplug test upstream
 
* Integrate Brew/Koji messaging with automatic job submission - done with messagebusd plugin
 
* Create initscripts for the scheduller daemon (monitor_db_babysitter) - done with effort by autoqa project
 
* Revisit job parameterization to ease job submission - done with simple templating, cartesian config override and site extension
 
  
 
== Bugs ==
 
== Bugs ==
  
 
* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]
 
* Please open bugs on the [[http://autotest.kernel.org/newticket autotest defect tracking system]]

Revision as of 03:22, 29 June 2011

KVM-Autotest TODO list

raw idea

  • more vhost_net test
  • Add Multi-guests transfer test
  • transfer test between guest(s) and extra boxs
  • add more whql tests (virtio_net,virtio_blk)

general

Note: This session is for major, multi-person items. We'll update the status weekly based on the status of the subtasks attributed to persons.

lmr

TODO

Done

mgoldish

  • Make WHQL tests run on our internal server
  • Enable "guest-load" for a VMs before/while tests are running (e.g. migration of a VM, while a movie is playing on it)
    • This may just be a matter of moving useful code from tests to kvm_test_utils.py to make it reusable

done

akong

  • push redhat internal kvm subtests(more than 18) to upstream

hdparm.py cpuflags.py multi_disk.py nmi_watchdog.py qmp_command.py qmp_event_notification.py cdrom.py fillup_disk.py floppy.py format_disk.py lvm.py usb.py ... [doing..] stop_continue.py[review..] image_copy.py module_probe.py[done]

jason

  • Port network tests into windows
  • Profiler of pidstat
  • guest->guest guest->host netperf support
  • More readable test result of netperf

yolkfull

  • Run netperf test between two guests
  • Migration with/without workload(dbench,lmbench etc)
  • Verify SMBIOS/DMI data (UUID, for example)
  • Disk serial number (for IDE, SCSI, VirtIO drives)

Beijing QE

  • pxe boot * net types
  • Further migration
  • Multiple nics
  • multiple disks
  • Test block device cancellation path using device mapper to generate errors ( after we had a crash in de_write_dma_cb)
  • Extend pci_assignable to support other PCI devices (USB, video cards, TV card etc)
  • Different CPU flags support
  • Passthrough the perf keys of run_autotest to autotest server
  • Register the virtual machine into autotest server and run benchmark through autotest server

Cleber

Bugs