桌面应用自动化winappdriver

关于winappdriver

介绍

WinAppDriver全称是Windows Application Driver，它提供了一些API，使得用户可以像selenium操作web一样来操作windows的应用程序
它支持的系统是Windows 10 (Home and Pro) 和Windows Server 2016
源码暂未开源
WinAppDriver可以独立运行，也可以作为appium的一个插件来使用

支持应用类型

UWP – Universal Windows Platform, also known as Universal Apps or Modern Apps, It's Microsoft’s latest desktop application technology. It's XAML based. Only runs on Windows 10 machines
WPF - also XAML based, much more mature, runs on any Windows version and has been around since 2006.

WinForms - one of the older technologies, now found mostly on legacy applications.

WPF和WinForms 是两套界面渲染方式。一个是对传统windows界面元素的封装，通过gdi绘制。另一个是全新的dx渲染绘制的界面，也脱离了对传统windows控件的依赖，没有历史包袱，理论上可以展现更炫酷的界面。

MFC/Classic Windows - MFC is a UI library normally paired with Win32 applications. This option is normally chosen when more efficiency is needed with low-level C++ handling or when supporting non-Microsoft platforms.

资源

素材	地址	说明
FlaUInspect	https://github.com/FlaUI/FlaUInspect/releases	定位工具
WinAppDriver	https://github.com/microsoft/WinAppDriver/releases/tag/v1.2.1
UIRecorder	https://github.com/microsoft/WinAppDriver/tree/master/Tools/UIRecorder	定位工具
inspect	微软官方工具集成于 Windows SDK	定位工具

UIRecorder(下文不涉及,仅供参考与备忘)

Open WinAppDriverUIRecorder.sln in Visual Studio

Select Debug > Start Debugging or simply Run

支持的定位方式

Client API	Locator Strategy	Matched Attribute in `inspect.exe`	Example
FindElementByAccessibilityId	accessibility id	AutomationId	AppNameTitle
FindElementByClassName	class name	ClassName	TextBlock
FindElementById	id	RuntimeId (decimal)	42.333896.3.1
FindElementByName	name	Name	Calculator
FindElementByTagName	tag name	LocalizedControlType (upper camel case)	Text
FindElementByXPath	xpath	Any	//Button[0]

配置

开启windows的开发者模式

你没看错，不是手机，windows也有
第一步：搜开发者设置
第二步：打开开发人员模式

第三步：确认启用

启动winappdriver

不开启开发人员模式的提示

C:\Program Files (x86)\Windows Application Driver>WinAppDriver.exe

Developer mode is not enabled. Enable it through Settings and restart Windows Application Driver

Failed to initialize: 0x80004005

开启后启动winappdriver

C:\Program Files (x86)\Windows Application Driver>WinAppDriver.exe

Windows Application Driver listening for requests at: http://127.0.0.1:4723/

Press ENTER to exit.

还可以这样启动

WinAppDriver.exe 4727

WinAppDriver.exe 10.0.0.10 4725

WinAppDriver.exe 10.0.0.10 4723/wd/hub   # 推荐

实例

appium-python-client 版本不要用2.0+，此处是1.2.0

记事本

比如记事本

from appium import webdriver

des_cap = {}

des_cap['app'] = r'C:\Windows\System32\notepad.exe'

driver = webdriver.Remote(command_executor='http://127.0.0.1:4723/wd/hub',

                          desired_capabilities=des_cap)

driver.implicitly_wait(5)

driver.find_element_by_name('文件(F)').click()

from time import sleep

sleep(2)

driver.find_element_by_name('保存(S)	Ctrl+S').click()

# driver.find_element_by_name('退出(X)').click()

sleep(1)

import pyautogui

pyautogui.PAUSE = 0.5

pyautogui.typewrite(r'D:\hello.txt')

pyautogui.press('enter')

这里的难点是保存(S) Ctrl+S的获取
这里需要用到inspect.exe

计算器

你可能会写这样的代码

from appium import webdriver

des_cap = {}

des_cap['app'] = r'C:\Windows\System32\calc.exe'

driver = webdriver.Remote(command_executor='http://127.0.0.1:4723/wd/hub',

                          desired_capabilities=des_cap)

driver.implicitly_wait(5)

但会报错

Traceback (most recent call last):

  File "D:/demo_calc.py", line 5, in <module>

    desired_capabilities=des_cap)

  File "D:\Python37\lib\site-packages\appium\webdriver\webdriver.py", line 157, in __init__

    AppiumConnection(command_executor, keep_alive=keep_alive), desired_capabilities, browser_profile, proxy

  File "D:\Python37\lib\site-packages\selenium\webdriver\remote\webdriver.py", line 157, in __init__

    self.start_session(capabilities, browser_profile)

  File "D:\Python37\lib\site-packages\appium\webdriver\webdriver.py", line 226, in start_session

    response = self.execute(RemoteCommand.NEW_SESSION, parameters)

  File "D:\Python37\lib\site-packages\selenium\webdriver\remote\webdriver.py", line 321, in execute

    self.error_handler.check_response(response)

  File "D:\Python37\lib\site-packages\selenium\webdriver\remote\errorhandler.py", line 242, in check_response

    raise exception_class(message, screen, stacktrace)

selenium.common.exceptions.WebDriverException: Message: Failed to locate opened application window with appId: C:\Windows\System32\calc.exe, and processId: 4472

进程已结束，退出代码为 1

打开计算器，然后在powershell中执行如下命令

Get-StartApps |Select-String "计算器"

# 输出

@{Name=计算器; AppID=Microsoft.WindowsCalculator_8wekyb3d8bbwe!App} # 你要的是这里的AppID

代码

from appium import webdriver

des_cap = {}

des_cap['app'] = r'Microsoft.WindowsCalculator_8wekyb3d8bbwe!App'

driver = webdriver.Remote(command_executor='http://127.0.0.1:4723/wd/hub',

                          desired_capabilities=des_cap)

driver.implicitly_wait(5)

driver.find_element_by_name('一').click()

driver.find_element_by_name('二').click()

driver.find_element_by_name('加').click()

driver.find_element_by_name('三').click()

driver.find_element_by_name('四').click()

driver.find_element_by_name('等于').click()

# 通过inspect 获取 automationID

print(driver.find_element_by_accessibility_id('CalculatorResults').text) # 得到的是   ·显示为 46·  你仍然要处理才能做测试

driver.quit()

计算器测试(官网)

我没跑

# https://raw.githubusercontent.com/microsoft/WinAppDriver/master/Samples/Python/calculatortest.py

import unittest

from appium import webdriver

class SimpleCalculatorTests(unittest.TestCase):

    @classmethod

    def setUpClass(self):

        #set up appium

        desired_caps = {}

        desired_caps["app"] = "Microsoft.WindowsCalculator_8wekyb3d8bbwe!App"

        self.driver = webdriver.Remote(

            command_executor='http://127.0.0.1:4723',

            desired_capabilities= desired_caps)

    @classmethod

    def tearDownClass(self):

        self.driver.quit()

    def getresults(self):

        displaytext = self.driver.find_element_by_accessibility_id("CalculatorResults").text

        displaytext = displaytext.strip("Display is " )

        displaytext = displaytext.rstrip(' ')

        displaytext = displaytext.lstrip(' ')

        return displaytext

    def test_initialize(self):

        self.driver.find_element_by_name("Clear").click()

        self.driver.find_element_by_name("Seven").click()

        self.assertEqual(self.getresults(),"7")

        self.driver.find_element_by_name("Clear").click()

    def test_addition(self):

        self.driver.find_element_by_name("One").click()

        self.driver.find_element_by_name("Plus").click()

        self.driver.find_element_by_name("Seven").click()

        self.driver.find_element_by_name("Equals").click()

        self.assertEqual(self.getresults(),"8")

    def test_combination(self):

        self.driver.find_element_by_name("Seven").click()

        self.driver.find_element_by_name("Multiply by").click()

        self.driver.find_element_by_name("Nine").click()

        self.driver.find_element_by_name("Plus").click()

        self.driver.find_element_by_name("One").click()

        self.driver.find_element_by_name("Equals").click()

        self.driver.find_element_by_name("Divide by").click()

        self.driver.find_element_by_name("Eight").click()

        self.driver.find_element_by_name("Equals").click()

        self.assertEqual(self.getresults(),"8")

    def test_division(self):

        self.driver.find_element_by_name("Eight").click()

        self.driver.find_element_by_name("Eight").click()

        self.driver.find_element_by_name("Divide by").click()

        self.driver.find_element_by_name("One").click()

        self.driver.find_element_by_name("One").click()

        self.driver.find_element_by_name("Equals").click()

        self.assertEqual(self.getresults(),"8")

    def test_multiplication(self):

        self.driver.find_element_by_name("Nine").click()

        self.driver.find_element_by_name("Multiply by").click()

        self.driver.find_element_by_name("Nine").click()

        self.driver.find_element_by_name("Equals").click()

        self.assertEqual(self.getresults(),"81") 

    def test_subtraction(self):

        self.driver.find_element_by_name("Nine").click()

        self.driver.find_element_by_name("Minus").click()

        self.driver.find_element_by_name("One").click()

        self.driver.find_element_by_name("Equals").click()

        self.assertEqual(self.getresults(),"8")

if __name__ == '__main__':

    suite = unittest.TestLoader().loadTestsFromTestCase(SimpleCalculatorTests)

    unittest.TextTestRunner(verbosity=2).run(suite)

巴特西

桌面应用自动化winappdriver

桌面应用自动化winappdriver

关于winappdriver

介绍

支持应用类型

资源

支持的定位方式

配置

开启windows的开发者模式

启动winappdriver

实例

记事本

计算器

计算器测试(官网)

最新文章

热门文章