d4665f2c56ca9dfc6b8eee567809ee14 308693.pdf f70f7c9f282f05291f9e6619792c5eefbf7b421b 308693.pdf ef6e3f2439c567617f9845d9a5d4ed6e131b09467e3bdfe57497c2658ef56fda 308693.pdf Title: Validation of a Questionnaire to Assess the Usability of and User Experience with Mobile Health Applications Subject: Background/objectives: The growing use of mobile health (mHealth) applications needs reliable tools to assess their usability and user experience in clinical practice to improve the digital health (eHealth) interventions and ensure engagement, as higher engagement is often linked to increased efficacy of healthcare interventions. This study aimed to validate the patient Satisfaction and Usability with APPs questionnaire (pSUAPP), a multidimensional tool designed for the comprehensive assessment of mHealth applications, particularly for the integrated follow-up of patients with chronic diseases. Methods: A validation study was conducted between August and December 2022 with 85 participants from two hospitals in Spain, who completed the pSUAPP questionnaire, comprising 27 Likert-like items across four dimensions: first contact, registration, features and overall experience, and 1 open question. The questionnaire was validated by a panel of 11 experts and further assessed for psychometric properties. Results: The mean pSUAPP score was 79.0 (SD = 12.0), indicating high usability and positive user experience, with the highest scores in the ‘features’ dimension. The pSUAPP demonstrated moderate correlation with the System Usability Scale (SUS) and high reliability (Cronbach’s alpha and omega t > 0.9). A reproducibility analysis showed negligible changes between repeated measures. Conclusions: The pSUAPP questionnaire was found to be a robust tool for evaluating mHealth app usability and user experience, with potential application across various clinical settings. Keywords: user-centred design; user experience; mobile health; mHealth; healthcare application; comprehensive healthcare; surveys and questionnaires; patient satisfaction Author: Anna de Dios López, Jordi Real, Claudia Meza, Alicia Borras-Santos, Roberto Collado-Borrell, Vicente Escudero-Vilaplana and Mar Gomis-Pastor Creator: LaTeX with hyperref Producer: pdfTeX-1.40.25 CreationDate: Fri Nov 22 02:41:29 2024 CET ModDate: Fri Nov 22 02:51:07 2024 CET Custom Metadata: no Metadata Stream: no Tagged: no UserProperties: no Suspects: no Form: none JavaScript: no Pages: 12 Encrypted: no Page size: 595.276 x 841.89 pts (A4) Page rot: 0 File size: 1146232 bytes Optimized: no PDF version: 1.7 name type encoding emb sub uni object ID ------------------------------------ ----------------- ---------------- --- --- --- --------- SOZKOC+VnURWPalladioL-Bold Type 1 Custom yes yes yes 10 0 HAUHDJ+URWPalladioL-Bold Type 1 Custom yes yes yes 16 0 IWWFGS+URWPalladioL-Roma Type 1 Custom yes yes yes 22 0 SSZVZM+URWPalladioL-Ital Type 1 Custom yes yes yes 27 0 MWHIBA+VnURWPalladioL Type 1 Custom yes yes yes 32 0 DWQKHT+URWPalladioL-BoldItal Type 1 Custom yes yes yes 71 0 FXXUVH+CMSY10 Type 1 Builtin yes yes yes 79 0 APDJPH+PalatinoLinotype,Bold TrueType WinAnsi yes yes no 107 0 APDJPJ+PalatinoLinotype TrueType WinAnsi yes yes no 110 0 APDJPL+PalatinoLinotype,Italic TrueType WinAnsi yes yes no 113 0 APDLHE+PalatinoLinotype,BoldItalic TrueType WinAnsi yes yes no 116 0 APDJPH+PalatinoLinotype,Bold TrueType WinAnsi yes yes no 158 0 APDJPI+PalatinoLinotype CID TrueType Identity-H yes yes yes 161 0 APDJPJ+PalatinoLinotype TrueType WinAnsi yes yes no 167 0 APDJPL+PalatinoLinotype,Italic TrueType WinAnsi yes yes no 170 0 APDLHE+PalatinoLinotype,BoldItalic TrueType WinAnsi yes yes no 173 0 APDJPH+PalatinoLinotype,Bold TrueType WinAnsi yes yes no 189 0 APDJPJ+PalatinoLinotype TrueType WinAnsi yes yes no 192 0 APDJPL+PalatinoLinotype,Italic TrueType WinAnsi yes yes no 195 0 SYVAVM+VnURWPalladioL-Italic Type 1 Custom yes yes yes 209 0 SMRSID+EURM10 Type 1 Builtin yes yes yes 218 0 Jhove (Rel. 1.28.0, 2023-05-18) Date: 2025-03-11 02:42:58 CET RepresentationInformation: 308693.pdf ReportingModule: PDF-hul, Rel. 1.12.4 (2023-03-16) LastModified: 2025-03-10 14:15:08 CET Size: 1146232 Format: PDF Version: 1.7 Status: Well-Formed and valid SignatureMatches: PDF-hul MIMEtype: application/pdf PDFMetadata: Objects: 368 FreeObjects: 1 IncrementalUpdates: 0 DocumentCatalog: PageLayout: SinglePage PageMode: UseNone Outlines: Item: Title: Introduction Destination: section.1 Item: Title: Methods Destination: section.2 Children: Item: Title: Study Design Destination: subsection.2.1 Item: Title: Questionnaire Destination: subsection.2.2 Item: Title: Participants Destination: subsection.2.3 Item: Title: Variables Destination: subsection.2.4 Item: Title: Statistical Analysis Destination: subsection.2.5 Item: Title: Results Destination: section.3 Children: Item: Title: Participants Characteristics Destination: subsection.3.1 Item: Title: pSUAPP Psychometric Evaluation Destination: subsection.3.2 Item: Title: Convergent Validity Destination: subsection.3.3 Item: Title: Reliability Destination: subsection.3.4 Item: Title: Reproducibility Destination: subsection.3.5 Item: Title: Dimensionality Destination: subsection.3.6 Item: Title: Discussion Destination: section.4 Item: Title: Conclusions Destination: section.5 Item: Title: References Destination: appendix.A. Info: Title: Validation of a Questionnaire to Assess the Usability of and User Experience with Mobile Health Applications Author: Anna de Dios López, Jordi Real, Claudia Meza, Alicia Borras-Santos, Roberto Collado-Borrell, Vicente Escudero-Vilaplana and Mar Gomis-Pastor Subject: Background/objectives: The growing use of mobile health (mHealth) applications needs reliable tools to assess their usability and user experience in clinical practice to improve the digital health (eHealth) interventions and ensure engagement, as higher engagement is often linked to increased efficacy of healthcare interventions. This study aimed to validate the patient Satisfaction and Usability with APPs questionnaire (pSUAPP), a multidimensional tool designed for the comprehensive assessment of mHealth applications, particularly for the integrated follow-up of patients with chronic diseases. Methods: A validation study was conducted between August and December 2022 with 85 participants from two hospitals in Spain, who completed the pSUAPP questionnaire, comprising 27 Likert-like items across four dimensions: first contact, registration, features and overall experience, and 1 open question. The questionnaire was validated by a panel of 11 experts and further assessed for psychometric properties. Results: The mean pSUAPP score was 79.0 (SD = 12.0), indicating high usability and positive user experience, with the highest scores in the ‘features’ dimension. The pSUAPP demonstrated moderate correlation with the System Usability Scale (SUS) and high reliability (Cronbach’s alpha and omega t > 0.9). A reproducibility analysis showed negligible changes between repeated measures. Conclusions: The pSUAPP questionnaire was found to be a robust tool for evaluating mHealth app usability and user experience, with potential application across various clinical settings. Keywords: user-centred design; user experience; mobile health; mHealth; healthcare application; comprehensive healthcare; surveys and questionnaires; patient satisfaction Creator: LaTeX with hyperref Producer: pdfTeX-1.40.25 CreationDate: Fri Nov 22 02:41:29 CET 2024 ModDate: Fri Nov 22 02:51:07 CET 2024 ID: 0x6b578c391b55a73a3fada1f101444436, 0x6b578c391b55a73a3fada1f101444436 Filters: FilterPipeline: FlateDecode Fonts: Type1: Font: BaseFont: MWHIBA+VnURWPalladioL FontSubset: true FirstChar: 161 LastChar: 226 FontDescriptor: FontName: MWHIBA+VnURWPalladioL Flags: Symbolic FontBBox: -166, -283, 1021, 943 FontFile: true EncodingDictionary: Differences: true ToUnicode: true Font: BaseFont: HAUHDJ+URWPalladioL-Bold FontSubset: true FirstChar: 2 LastChar: 122 FontDescriptor: FontName: HAUHDJ+URWPalladioL-Bold Flags: Symbolic FontBBox: -152, -301, 1000, 935 FontFile: true EncodingDictionary: Differences: true ToUnicode: true Font: BaseFont: SYVAVM+VnURWPalladioL-Italic FontSubset: true FirstChar: 226 LastChar: 226 FontDescriptor: FontName: SYVAVM+VnURWPalladioL-Italic Flags: Symbolic FontBBox: -170, -305, 1010, 941 FontFile: true EncodingDictionary: Differences: true ToUnicode: true Font: BaseFont: IWWFGS+URWPalladioL-Roma FontSubset: true FirstChar: 2 LastChar: 246 FontDescriptor: FontName: IWWFGS+URWPalladioL-Roma Flags: Symbolic FontBBox: -166, -283, 1021, 943 FontFile: true EncodingDictionary: Differences: true ToUnicode: true Font: BaseFont: DWQKHT+URWPalladioL-BoldItal FontSubset: true FirstChar: 104 LastChar: 116 FontDescriptor: FontName: DWQKHT+URWPalladioL-BoldItal Flags: Symbolic FontBBox: -170, -300, 1073, 935 FontFile: true EncodingDictionary: Differences: true ToUnicode: true Font: BaseFont: SOZKOC+VnURWPalladioL-Bold FontSubset: true FirstChar: 226 LastChar: 226 FontDescriptor: FontName: SOZKOC+VnURWPalladioL-Bold Flags: Symbolic FontBBox: -152, -301, 1000, 935 FontFile: true EncodingDictionary: Differences: true ToUnicode: true Font: BaseFont: SMRSID+EURM10 FontSubset: true FirstChar: 11 LastChar: 33 FontDescriptor: FontName: SMRSID+EURM10 Flags: Symbolic FontBBox: -32, -243, 1060, 720 FontFile: true ToUnicode: true Font: BaseFont: SSZVZM+URWPalladioL-Ital FontSubset: true FirstChar: 45 LastChar: 121 FontDescriptor: FontName: SSZVZM+URWPalladioL-Ital Flags: Symbolic FontBBox: -170, -305, 1010, 941 FontFile: true EncodingDictionary: Differences: true ToUnicode: true Font: BaseFont: FXXUVH+CMSY10 FontSubset: true FirstChar: 0 LastChar: 0 FontDescriptor: FontName: FXXUVH+CMSY10 Flags: Symbolic FontBBox: -29, -960, 1116, 775 FontFile: true ToUnicode: true Pages: Page: Sequence: 1 Annotations: Annotation: Subtype: Link Rect: 34, 279, 152, 288 Annotation: Subtype: Link Rect: 34, 269, 96, 276 Annotation: Subtype: Link Rect: 34, 164, 96, 186 Annotation: Subtype: Link Rect: 126, 90, 154, 99 Annotation: Subtype: Link Rect: 34, 78, 149, 87 Annotation: Subtype: Link Rect: 34, 756, 153, 792 Annotation: Subtype: Link Rect: 515, 756, 560, 792 Annotation: Subtype: Link Rect: 153, 660, 164, 674 Annotation: Subtype: Link Rect: 226, 660, 237, 674 Annotation: Subtype: Link Rect: 426, 660, 438, 674 Annotation: Subtype: Link Rect: 167, 648, 178, 661 Annotation: Subtype: Link Rect: 311, 148, 318, 157 ActionDest: 206 Annotation: Subtype: Link Rect: 318, 148, 325, 157 ActionDest: 206 Annotation: Subtype: Link Rect: 374, 123, 381, 132 ActionDest: 206 Annotation: Subtype: Link Rect: 349, 85, 356, 94 ActionDest: 206 Annotation: Subtype: Link Rect: 356, 85, 363, 94 ActionDest: 206 Annotation: Subtype: Link Rect: 123, 17, 283, 28 Annotation: Subtype: Link Rect: 400, 17, 560, 28 Annotation: Subtype: Link Rect: 34, 388, 87, 407 Page: Sequence: 2 Annotations: Annotation: Subtype: Link Rect: 255, 743, 262, 752 ActionDest: 206 Annotation: Subtype: Link Rect: 255, 681, 262, 690 ActionDest: 206 Annotation: Subtype: Link Rect: 262, 681, 269, 690 ActionDest: 206 Annotation: Subtype: Link Rect: 494, 655, 501, 665 ActionDest: 206 Annotation: Subtype: Link Rect: 257, 618, 264, 627 ActionDest: 206 Annotation: Subtype: Link Rect: 236, 580, 248, 589 ActionDest: 206 Annotation: Subtype: Link Rect: 281, 555, 292, 564 ActionDest: 206 Annotation: Subtype: Link Rect: 280, 492, 292, 501 ActionDest: 206 Annotation: Subtype: Link Rect: 335, 430, 347, 439 ActionDest: 206 Annotation: Subtype: Link Rect: 380, 392, 392, 401 ActionDest: 206 Annotation: Subtype: Link Rect: 448, 367, 460, 376 ActionDest: 206 Annotation: Subtype: Link Rect: 460, 367, 472, 376 ActionDest: 206 Annotation: Subtype: Link Rect: 231, 342, 243, 351 ActionDest: 206 Annotation: Subtype: Link Rect: 243, 342, 255, 351 ActionDest: 206 Annotation: Subtype: Link Rect: 251, 317, 258, 326 ActionDest: 206 Annotation: Subtype: Link Rect: 519, 266, 531, 275 ActionDest: 206 Page: Sequence: 3 Annotations: Annotation: Subtype: Link Rect: 544, 718, 556, 727 ActionDest: 206 Annotation: Subtype: Link Rect: 337, 706, 349, 715 ActionDest: 206 Annotation: Subtype: Link Rect: 212, 479, 224, 489 ActionDest: 206 Annotation: Subtype: Link Rect: 305, 479, 317, 489 ActionDest: 206 Annotation: Subtype: Link Rect: 486, 341, 498, 350 ActionDest: 206 Annotation: Subtype: Link Rect: 247, 291, 259, 300 ActionDest: 206 Annotation: Subtype: Link Rect: 260, 291, 272, 300 ActionDest: 206 Page: Sequence: 4 Annotations: Annotation: Subtype: Link Rect: 544, 605, 556, 614 ActionDest: 206 Annotation: Subtype: Link Rect: 533, 542, 540, 551 ActionDest: 206 Annotation: Subtype: Link Rect: 543, 542, 555, 551 ActionDest: 206 Annotation: Subtype: Link Rect: 374, 517, 386, 526 ActionDest: 215 Annotation: Subtype: Link Rect: 386, 517, 398, 526 ActionDest: 215 Annotation: Subtype: Link Rect: 530, 429, 537, 438 ActionDest: 206 Annotation: Subtype: Link Rect: 540, 429, 546, 438 ActionDest: 206 Annotation: Subtype: Link Rect: 547, 429, 559, 438 ActionDest: 206 Annotation: Subtype: Link Rect: 164, 417, 176, 426 ActionDest: 206 Annotation: Subtype: Link Rect: 177, 417, 188, 426 ActionDest: 206 Annotation: Subtype: Link Rect: 191, 417, 203, 426 ActionDest: 215 Annotation: Subtype: Link Rect: 304, 367, 311, 376 ActionDest: 206 Annotation: Subtype: Link Rect: 311, 366, 323, 376 ActionDest: 206 Annotation: Subtype: Link Rect: 324, 366, 336, 376 ActionDest: 206 Annotation: Subtype: Link Rect: 336, 367, 348, 376 ActionDest: 206 Annotation: Subtype: Link Rect: 349, 367, 361, 376 ActionDest: 206 Annotation: Subtype: Link Rect: 361, 367, 373, 376 ActionDest: 215 Annotation: Subtype: Link Rect: 544, 304, 556, 313 ActionDest: 206 Annotation: Subtype: Link Rect: 196, 216, 208, 225 ActionDest: 206 Annotation: Subtype: Link Rect: 346, 90, 358, 99 ActionDest: 215 Page: Sequence: 5 Annotations: Annotation: Subtype: Link Rect: 326, 388, 333, 400 ActionDest: 68 Annotation: Subtype: Link Rect: 293, 90, 300, 102 ActionDest: 76 Annotation: Subtype: Link Rect: 310, 77, 317, 89 ActionDest: 76 Annotation: Subtype: Link Rect: 368, 77, 375, 89 ActionDest: 76 Page: Sequence: 6 Annotations: Annotation: Subtype: Link Rect: 289, 208, 296, 220 ActionDest: 76 Page: Sequence: 7 Annotations: Annotation: Subtype: Link Rect: 219, 716, 226, 728 ActionDest: 76 Annotation: Subtype: Link Rect: 219, 641, 226, 652 ActionDest: 129 Annotation: Subtype: Link Rect: 549, 244, 556, 256 ActionDest: 129 Page: Sequence: 8 Annotations: Annotation: Subtype: Link Rect: 539, 700, 546, 712 ActionDest: 132 Annotation: Subtype: Link Rect: 236, 650, 243, 662 ActionDest: 132 Page: Sequence: 9 Annotations: Annotation: Subtype: Link Rect: 211, 640, 222, 649 ActionDest: 206 Annotation: Subtype: Link Rect: 223, 640, 235, 649 ActionDest: 215 Annotation: Subtype: Link Rect: 236, 640, 248, 649 ActionDest: 215 Annotation: Subtype: Link Rect: 223, 452, 235, 461 ActionDest: 215 Annotation: Subtype: Link Rect: 236, 452, 248, 461 ActionDest: 215 Annotation: Subtype: Link Rect: 390, 439, 402, 448 ActionDest: 206 Annotation: Subtype: Link Rect: 402, 439, 414, 448 ActionDest: 215 Annotation: Subtype: Link Rect: 222, 414, 234, 423 ActionDest: 215 Annotation: Subtype: Link Rect: 477, 389, 488, 398 ActionDest: 206 Annotation: Subtype: Link Rect: 489, 389, 501, 398 ActionDest: 215 Annotation: Subtype: Link Rect: 375, 364, 382, 373 ActionDest: 206 Annotation: Subtype: Link Rect: 382, 364, 394, 373 ActionDest: 215 Annotation: Subtype: Link Rect: 188, 314, 200, 323 ActionDest: 206 Page: Sequence: 10 Annotations: Annotation: Subtype: Link Rect: 526, 302, 560, 313 Annotation: Subtype: Link Rect: 165, 290, 381, 301 Annotation: Subtype: Link Rect: 260, 269, 271, 277 ActionDest: 206 Page: Sequence: 11 Annotations: Annotation: Subtype: Link Rect: 172, 600, 209, 610 Annotation: Subtype: Link Rect: 215, 600, 251, 610 Annotation: Subtype: Link Rect: 366, 576, 404, 587 Annotation: Subtype: Link Rect: 410, 576, 446, 587 Annotation: Subtype: Link Rect: 59, 543, 96, 553 Annotation: Subtype: Link Rect: 394, 531, 432, 541 Annotation: Subtype: Link Rect: 440, 507, 477, 518 Annotation: Subtype: Link Rect: 345, 484, 383, 495 Annotation: Subtype: Link Rect: 389, 484, 425, 495 Annotation: Subtype: Link Rect: 459, 461, 497, 472 Annotation: Subtype: Link Rect: 296, 427, 334, 438 Annotation: Subtype: Link Rect: 371, 404, 409, 415 Annotation: Subtype: Link Rect: 186, 358, 223, 369 Annotation: Subtype: Link Rect: 274, 335, 312, 346 Annotation: Subtype: Link Rect: 423, 312, 460, 323 Annotation: Subtype: Link Rect: 153, 278, 190, 288 Annotation: Subtype: Link Rect: 148, 254, 423, 265 Annotation: Subtype: Link Rect: 440, 243, 560, 254 Annotation: Subtype: Link Rect: 56, 231, 437, 242 Annotation: Subtype: Link Rect: 187, 186, 224, 196 Annotation: Subtype: Link Rect: 420, 127, 457, 138 Annotation: Subtype: Link Rect: 183, 116, 317, 127 Annotation: Subtype: Link Rect: 393, 104, 560, 115 Annotation: Subtype: Link Rect: 56, 93, 227, 104 Annotation: Subtype: Link Rect: 520, 70, 557, 81 Page: Sequence: 12 Annotations: Annotation: Subtype: Link Rect: 445, 718, 483, 729 Annotation: Subtype: Link Rect: 386, 695, 424, 706 Annotation: Subtype: Link Rect: 430, 695, 466, 706 Annotation: Subtype: Link Rect: 430, 672, 467, 683 Annotation: Subtype: Link Rect: 284, 637, 322, 648 Annotation: Subtype: Link Rect: 185, 614, 223, 625 Annotation: Subtype: Link Rect: 271, 591, 308, 602 Annotation: Subtype: Link Rect: 95, 558, 133, 568 Annotation: Subtype: Link Rect: 519, 534, 557, 545 Annotation: Subtype: Link Rect: 435, 511, 472, 522 Checksum: 2403fd8e Type: CRC32 Checksum: d4665f2c56ca9dfc6b8eee567809ee14 Type: MD5 Checksum: f70f7c9f282f05291f9e6619792c5eefbf7b421b Type: SHA-1 Checksum: ef6e3f2439c567617f9845d9a5d4ed6e131b09467e3bdfe57497c2658ef56fda Type: SHA-256