ConnMan (0.66.1) Weekly Test Report - WW04

Zheng, Jeff jeff.zheng at intel.com
Fri Jan 21 02:24:38 PST 2011


Hi all,

This is test report for ConnMan upstream connman-0.66.1. In this testing,
we ran 331 cases. 304 cases passed and 27 case failed because of known/new
bug. The pass rate is 92%. We found 4 new bugs and verified 5 bug

Verified Bugs
===============================================
[11879] connman crash when reconnect to the wifi.
http://bugs.meego.com/show_bug.cgi?id=11879

[10454] ConnMan takes more than 5 munites to show wifi APs after killed/restart
http://bugs.meego.com/show_bug.cgi?id=10454

[10205] WiFi plugin issues after connmand kill/restart
http://bugs.meego.com/show_bug.cgi?id=10205

[11315] WiMAX plugin build failure with upstream ConnMan
http://bugs.meego.com/show_bug.cgi?id=11315

[8036] service list should order "associating" before "idle"
http://bugs.meego.com/show_bug.cgi?id=8036


New bugs
===============================================
[12696] Connect another wifi AP cause net.connman.Error.
http://bugs.meego.com/show_bug.cgi?id=12696

[12698] Connman crash when set ipv6 for bluetooth.
http://bugs.meego.com/show_bug.cgi?id=12698

[12505] Connect to AP with TTLS failed
http://bugs.meego.com/show_bug.cgi?id=10505

[12508] OpenVPN does not work
http://bugs.meego.com/show_bug.cgi?id=12508



Testing Environment
==============================================
Hardware:       netbook ACER AspireOne NAV50/Eeepc 1005PE
Image:      meego-netbook-trunktesting-ia32-1.1.80.20110117.0919
ConnMan:   connman-0.66-1.1.i586
Ofono:      ofono-0.38.90.ge0e7346-1.1.i586
3G:             Unicom Sim card/Dell 5540/Dell 5530
BT:             Palm Pre/AnyCom AP/CSR dongle (disable the onboard BT device)
Wireless AP:    Linksys/Asus/Cisco 1252

Test Execution Summary
==============================================
Feature          Total      Pass   Fail     Comments
Ethernet           18        18
WiFi               38        38
3G                 27        27
BT                 21        21
VPN                11        10      1       #10018
Switch             12        12
Signal             13        13
IPV6               23        20      3       #12698
Flight             34        34
Launch             8         8
Info               15        15
Device             12        12
NetworkSel         11        1       10      #12696
Autoconnect        13        6       7       #11860 #12104
Advance            17        16      1       #5194
State              11        9       2       #3376
DHCP               13        11      2       #4281  #5194
Profile            6         5       1       #2513
Property           28        28
Total              331       304     27


Bug refered here is bug at bugs.meego.com, for example, bug #437 refer to
http://bugs.meego.com/show_bug.cgi?id=437
For detailed test results, please see attached file


Quality indicator
==============================================
Feature         Score   Comments
WiFi                    Good    Bug 5241, 12696
Intel WiMAX             N/A     QA does not have WiMAX test environment
Bluetooth PAN           Good    Bug 6956
3G data                 Buggy   Bug 6028, 10016, 10018, 10211, 10844
Wired (LAN)             Good
State                   Buggy   Bug 2514 3376
Flight                  Good
Network Selection       Good
wpa-suplicant D-BUS     Good
profile management      Good    Bug 2513
manual switch connect   Good
Wired/WiFi co-exexist   Good
Remember device status  Good
connect to Broadcast AP Good
connect to Hidden AP    Good
Hidden Group AP         Good
auto connect reboot     Good
auto connect Offline    Good
auto connect suspend    Good
favorite connection     Good
auto connectivity order Good
WEP 40/128-bit key      Good
WEP 128-bit passphrase  Good
WPA personal            Good
WPA2 personal           Good
Open system             Good
Shared Key              Good
Remember passwd         Good
forgot password         Good
AP security detect      Good
auto del non-exist AP   Good
VPN                     Good  10018, 10555
Plugin to oFono         Good
DNS Proxy               Good
DNS support via DHCP    Good
Static IP               Good
PPP 3G                  Good
WPA-enterprise          Good
dhcp-lib                Good #4281
ipv6                    Good #12698
wpad                    Good #10008
OpenVPN                 Buggy #12508
TTLS                    Buggy #12505
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: ConnMan_upstream_weekly_test_report_ww04.txt
URL: <http://lists.01.org/pipermail/connman/attachments/20110121/352ebf87/attachment.txt>


More information about the connman mailing list