2c7430287709b8d63b5257dc69d04ba2 Sen_a2020v20n8p2376.pdf ad3602ed81a718b26ff278a086948d5550bb7712 Sen_a2020v20n8p2376.pdf d61c4bbc1adb5b1c4cd56e2efa5a20be0fd0fbe9f2ca751518713921be77c5eb Sen_a2020v20n8p2376.pdf Title: Human Interaction Smart Subsystem—Extending Speech-Based Human-Robot Interaction Systems with an Implementation of External Smart Sensors Subject: This paper presents a more detailed concept of Human-Robot Interaction systems architecture. One of the main differences between the proposed architecture and other ones is the methodology of information acquisition regarding the robot's interlocutor. In order to obtain as much information as possible before the actual interaction took place, a custom Internet-of-Things-based sensor subsystems connected to Smart Infrastructure was designed and implemented, in order to support the interlocutor identification and acquisition of initial interaction parameters. The Artificial Intelligence interaction framework of the developed robotic system (including humanoid Pepper with its sensors and actuators, additional local, remote and cloud computing services) is being extended with the use of custom external subsystems for additional knowledge acquisition: device-based human identification, visual identification and audio-based interlocutor localization subsystems. These subsystems were deeply introduced and evaluated in this paper, presenting the benefits of integrating them into the robotic interaction system. In this paper a more detailed analysis of one of the external subsystems—Bluetooth Human Identification Smart Subsystem—was also included. The idea, use case, and a prototype, integration of elements of Smart Infrastructure systems and the prototype implementation were performed in a small front office of the Weegree company as a decent test-bed application area. Keywords: pepper robot; sensor networks; smart infrastructure; humanoid robots; cloud services; thermal imaging; COVID-19 Author: Michal Podpora, Arkadiusz Gardecki, Ryszard Beniak, Bartlomiej Klin, Jose Lopez Vicario and Aleksandra Kawala-Sterniuk Creator: LaTeX with hyperref package Producer: pdfTeX-1.40.18 CreationDate: Wed Apr 22 11:27:39 2020 CEST ModDate: Wed Apr 22 11:27:39 2020 CEST Tagged: no UserProperties: no Suspects: no Form: none JavaScript: no Pages: 16 Encrypted: no Page size: 595.276 x 841.89 pts (A4) Page rot: 0 File size: 2011162 bytes Optimized: no PDF version: 1.5 name type encoding emb sub uni object ID ------------------------------------ ----------------- ---------------- --- --- --- --------- BHFUPQ+URWPalladioL-Ital Type 1 Custom yes yes no 86 0 JLRPHP+URWPalladioL-Bold Type 1 Custom yes yes no 87 0 TYEZHV+URWPalladioL-Roma Type 1 Custom yes yes no 88 0 RVSEMT+TimesNewRomanPS-BoldItalicMT Type 1C WinAnsi yes yes no 93 0 MCBCCI+SourceSansRoman-Regular Type 1C Custom yes yes no 110 0 MCBCCM+SourceSansRoman.613wght Type 1C Custom yes yes no 111 0 MCBCCO+SourceSansRoman-Bold Type 1C Custom yes yes no 112 0 GFAWRG+CMSY10 Type 1 Builtin yes yes no 163 0 WEIJUK+CMSY9 Type 1 Builtin yes yes no 243 0 Jhove (Rel. 1.22.1, 2019-04-17) Date: 2022-07-20 02:32:38 CEST RepresentationInformation: Sen_a2020v20n8p2376.pdf ReportingModule: PDF-hul, Rel. 1.12.1 (2019-04-17) LastModified: 2022-07-19 17:12:09 CEST Size: 2011162 Format: PDF Version: 1.5 Status: Well-Formed and valid SignatureMatches: PDF-hul MIMEtype: application/pdf PDFMetadata: Objects: 0 FreeObjects: 2 IncrementalUpdates: 0 DocumentCatalog: ViewerPreferences: HideToolbar: false HideMenubar: false HideWindowUI: false FitWindow: true CenterWindow: false DisplayDocTitle: false NonFullScreenPageMode: UseNone Direction: L2R ViewArea: CropBox ViewClip: CropBox PrintArea: CropBox PageClip: CropBox PageLayout: SinglePage PageMode: UseNone Outlines: Item: Title: ぉのぴひはつふっぴどはの Item: Title: きちぴづひどちぬびぜ〴ぜ〰ちのつぜ〴ぜ〰きづぴとはつび Children: Item: Title: ぃはねねふのどっちぴどはのぜ〴ぜ〰ぢづぴぷづづのぜ〴ぜ〰ぃはねばはのづのぴびぜ〴ぜ〰ちのつぜ〴ぜ〰げづねはぴづぜ〴ぜ〰こぁこぜ〴ぜ〰げづぬどちぢどぬどぴべ Item: Title: こづのびはひびぜ〴ぜ〰げづぬどちぢどぬどぴべぜ〴ぜ〰ちのつぜ〴ぜ〰げづつふのつちのっべ Item: Title: ぉのてぬふづのっづぜ〴ぜ〰はてぜ〴ぜ〰いべのちねどっちぬぬべぜ〴ぜ〰ぃとちのでどのでぜ〴ぜ〰ぅのぶどひはのねづのぴ Item: Title: ざどつづはぜ〴ぜ〰ぉのばふぴぜ〴ぜ〰こぴひづちねぜ〴ぜ〰こふぢびべびぴづねぜ〴ぜ〰ぜ〵ぜ〰ざぉここぜ〵ㄩ਼㰠⽓ 䝯呯 䐠⡳畢獥捴楯渮㈮㔩‾㸊⡜㌷㙜㌷㝜〰ごとづひねはぶどびどはのぜ〴ぜ〰こふぢびべびぴづねぜ〴ぜ〰ぜ〵ぜ〰〲〰〲〰〭〰〳ぜ〴ぜ〰ぃはひはのちぶどひふびぜ〴ぜ〰さばつちぴづぜ〵ㄩ਼㰠⽓ 䝯呯 䐠⡳畢獥捴楯渮㈮㘩‾㸊⡜㌷㙜㌷㝜〰うづづつぢちっにぜ〴ぜ〰がははばぜ〴ぜ〰ぢづぴぷづづのぜ〴ぜ〰きどっひはばとはのづびぜ〴ぜ〰ちのつぜ〴ぜ〰こばづちにづひび Item: Title: ごとづひねはぶどびどはのぜ〴ぜ〰こふぢびべびぴづねぜ〴ぜ〰ぜ〵ぜ〰〲〰〲〰〭〰〳ぜ〴ぜ〰ぃはひはのちぶどひふびぜ〴ぜ〰さばつちぴづぜ〵ㄩ਼㰠⽓ 䝯呯 䐠⡳畢獥捴楯渮㈮㘩‾㸊⡜㌷㙜㌷㝜〰うづづつぢちっにぜ〴ぜ〰がははばぜ〴ぜ〰ぢづぴぷづづのぜ〴ぜ〰きどっひはばとはのづびぜ〴ぜ〰ちのつぜ〴ぜ〰こばづちにづひび Item: Title: うづづつぢちっにぜ〴ぜ〰がははばぜ〴ぜ〰ぢづぴぷづづのぜ〴ぜ〰きどっひはばとはのづびぜ〴ぜ〰ちのつぜ〴ぜ〰こばづちにづひび Item: Title: げうぉいぜ〴ぜ〰ちのつぜ〴ぜ〰あぬふづぴははぴとぜ〴ぜ〰こふぢびべびぴづねび〧ぜ〴ぜ〰ぃちばちぢどぬどぴどづびぜ〴ぜ〰ぁてぴづひぜ〴ぜ〰ぃはののづっぴどのでぜ〴ぜ〰ぴはぜ〴ぜ〰こねちひぴぜ〴ぜ〰ぉのてひちびぴひふっぴふひづ Item: Title: こねちひぴぜ〴ぜ〰こづのびはひびぜ〴ぜ〰ちのつぜ〴ぜ〰こねちひぴぜ〴ぜ〰ぉのてひちびぴひふっぴふひづ Item: Title: げづびふぬぴび Item: Title: いどびっふびびどはの Item: Title: ぃはのっぬふびどはのび Item: Title: げづてづひづのっづび Filters: FilterPipeline: FlateDecode Images: Image: NisoImageMetadata: FormatName: image/png ImageWidth: 1111 ImageHeight: 844 ColorSpace: RGB BitsPerSample: 8 BitsPerSampleUnit: integer Filter: FlateDecode Image: NisoImageMetadata: FormatName: image/png ImageWidth: 459 ImageHeight: 278 ColorSpace: RGB BitsPerSample: 8 BitsPerSampleUnit: integer Filter: FlateDecode Image: NisoImageMetadata: FormatName: image/png ImageWidth: 1171 ImageHeight: 431 ColorSpace: RGB BitsPerSample: 8 BitsPerSampleUnit: integer Filter: FlateDecode Image: NisoImageMetadata: FormatName: image/png ImageWidth: 1110 ImageHeight: 856 ColorSpace: RGB BitsPerSample: 8 BitsPerSampleUnit: integer Filter: FlateDecode Image: NisoImageMetadata: FormatName: image/png ImageWidth: 1100 ImageHeight: 1029 ColorSpace: RGB BitsPerSample: 8 BitsPerSampleUnit: integer Filter: FlateDecode Image: NisoImageMetadata: FormatName: image/png ImageWidth: 320 ImageHeight: 471 ColorSpace: RGB BitsPerSample: 8 BitsPerSampleUnit: integer Filter: FlateDecode Image: NisoImageMetadata: FormatName: image/png ImageWidth: 1575 ImageHeight: 681 ColorSpace: RGB BitsPerSample: 8 BitsPerSampleUnit: integer Filter: FlateDecode Image: NisoImageMetadata: FormatName: image/png ImageWidth: 664 ImageHeight: 443 ColorSpace: RGB BitsPerSample: 8 BitsPerSampleUnit: integer Filter: FlateDecode Fonts: Type1: Font: BaseFont: GFAWRG+CMSY10 FontSubset: true FirstChar: 15 LastChar: 15 FontDescriptor: FontName: GFAWRG+CMSY10 Flags: Symbolic FontBBox: -29, -960, 1116, 775 FontFile: true Font: BaseFont: WEIJUK+CMSY9 FontSubset: true FirstChar: 13 LastChar: 13 FontDescriptor: FontName: WEIJUK+CMSY9 Flags: Symbolic FontBBox: -29, -958, 1146, 777 FontFile: true Font: BaseFont: BHFUPQ+URWPalladioL-Ital FontSubset: true FirstChar: 3 LastChar: 121 FontDescriptor: FontName: BHFUPQ+URWPalladioL-Ital Flags: Symbolic FontBBox: -170, -305, 1010, 941 FontFile: true EncodingDictionary: Differences: true Font: BaseFont: JLRPHP+URWPalladioL-Bold FontSubset: true FirstChar: 3 LastChar: 151 FontDescriptor: FontName: JLRPHP+URWPalladioL-Bold Flags: Symbolic FontBBox: -152, -301, 1000, 935 FontFile: true EncodingDictionary: Differences: true Font: BaseFont: TYEZHV+URWPalladioL-Roma FontSubset: true FirstChar: 2 LastChar: 233 FontDescriptor: FontName: TYEZHV+URWPalladioL-Roma Flags: Symbolic FontBBox: -166, -283, 1021, 943 FontFile: true EncodingDictionary: Differences: true Pages: Page: Sequence: 1 Annotations: Annotation: Subtype: Link Rect: 75, 757, 194, 793 Annotation: Subtype: Link Rect: 474, 757, 519, 793 Annotation: Subtype: Link Rect: 173, 640, 184, 654 Annotation: Subtype: Link Rect: 297, 640, 309, 654 Annotation: Subtype: Link Rect: 401, 640, 412, 654 Annotation: Subtype: Link Rect: 499, 640, 510, 654 Annotation: Subtype: Link Rect: 172, 626, 183, 640 Annotation: Subtype: Link Rect: 348, 626, 359, 640 Annotation: Subtype: Link Rect: 466, 500, 518, 519 Annotation: Subtype: Link Rect: 167, 38, 235, 50 Annotation: Subtype: Link Rect: 399, 38, 519, 50 Page: Sequence: 2 Annotations: Annotation: Subtype: Link Rect: 143, 702, 150, 711 ActionDest: 325 Annotation: Subtype: Link Rect: 129, 661, 136, 670 ActionDest: 325 Annotation: Subtype: Link Rect: 344, 634, 351, 643 ActionDest: 325 Annotation: Subtype: Link Rect: 352, 634, 359, 643 ActionDest: 325 Annotation: Subtype: Link Rect: 244, 607, 251, 616 ActionDest: 325 Annotation: Subtype: Link Rect: 423, 540, 430, 549 ActionDest: 325 Annotation: Subtype: Link Rect: 359, 297, 366, 306 ActionDest: 325 Annotation: Subtype: Link Rect: 399, 283, 406, 292 ActionDest: 325 Annotation: Subtype: Link Rect: 480, 283, 487, 292 ActionDest: 325 Annotation: Subtype: Link Rect: 178, 270, 185, 279 ActionDest: 325 Annotation: Subtype: Link Rect: 241, 256, 248, 265 ActionDest: 325 Annotation: Subtype: Link Rect: 248, 256, 255, 265 ActionDest: 325 Annotation: Subtype: Link Rect: 256, 256, 263, 265 ActionDest: 325 Annotation: Subtype: Link Rect: 266, 256, 278, 265 ActionDest: 325 Annotation: Subtype: Link Rect: 129, 130, 136, 142 ActionDest: 158 Annotation: Subtype: Link Rect: 303, 103, 310, 115 ActionDest: 158 Page: Sequence: 3 Annotations: Annotation: Subtype: Link Rect: 419, 729, 431, 738 ActionDest: 325 Annotation: Subtype: Link Rect: 146, 333, 153, 345 ActionDest: 158 Page: Sequence: 4 Annotations: Annotation: Subtype: Link Rect: 201, 720, 208, 732 ActionDest: 158 Annotation: Subtype: Link Rect: 499, 709, 511, 718 ActionDest: 325 Annotation: Subtype: Link Rect: 405, 642, 417, 651 ActionDest: 325 Annotation: Subtype: Link Rect: 111, 327, 123, 336 ActionDest: 325 Annotation: Subtype: Link Rect: 126, 327, 138, 336 ActionDest: 343 Annotation: Subtype: Link Rect: 257, 327, 269, 336 ActionDest: 343 Annotation: Subtype: Link Rect: 310, 160, 317, 172 ActionDest: 191 Annotation: Subtype: Link Rect: 197, 146, 204, 158 ActionDest: 191 Page: Sequence: 5 Annotations: Annotation: Subtype: Link Rect: 142, 328, 149, 340 ActionDest: 191 Page: Sequence: 6 Annotations: Annotation: Subtype: Link Rect: 179, 702, 191, 711 ActionDest: 325 Annotation: Subtype: Link Rect: 192, 702, 204, 711 ActionDest: 343 Annotation: Subtype: Link Rect: 130, 534, 138, 546 ActionDest: 158 Annotation: Subtype: Link Rect: 291, 524, 303, 533 ActionDest: 343 Annotation: Subtype: Link Rect: 497, 494, 504, 506 ActionDest: 204 Page: Sequence: 7 Annotations: Annotation: Subtype: Link Rect: 437, 513, 449, 522 ActionDest: 343 Annotation: Subtype: Link Rect: 510, 230, 517, 242 ActionDest: 228 Annotation: Subtype: Link Rect: 398, 152, 410, 161 ActionDest: 343 Page: Sequence: 8 Annotations: Annotation: Subtype: Link Rect: 125, 198, 137, 208 ActionDest: 343 Annotation: Subtype: Link Rect: 504, 145, 516, 154 ActionDest: 343 Page: Sequence: 9 Annotations: Annotation: Subtype: Link Rect: 312, 477, 319, 489 ActionDest: 239 Annotation: Subtype: Link Rect: 379, 92, 390, 100 ActionDest: 343 Page: Sequence: 10 Annotations: Annotation: Subtype: Link Rect: 258, 633, 270, 642 ActionDest: 343 Annotation: Subtype: Link Rect: 174, 514, 181, 526 ActionDest: 204 Annotation: Subtype: Link Rect: 202, 514, 209, 526 ActionDest: 228 Annotation: Subtype: Link Rect: 131, 379, 138, 391 ActionDest: 268 Annotation: Subtype: Link Rect: 276, 242, 288, 251 ActionDest: 343 Annotation: Subtype: Link Rect: 146, 226, 153, 238 ActionDest: 268 Page: Sequence: 11 Annotations: Annotation: Subtype: Link Rect: 147, 496, 154, 508 ActionDest: 268 Annotation: Subtype: Link Rect: 256, 185, 263, 197 ActionDest: 204 Annotation: Subtype: Link Rect: 397, 161, 409, 170 ActionDest: 343 Annotation: Subtype: Link Rect: 232, 131, 239, 143 ActionDest: 239 Annotation: Subtype: Link Rect: 195, 120, 207, 129 ActionDest: 343 Annotation: Subtype: Link Rect: 333, 118, 340, 130 ActionDest: 268 Annotation: Subtype: Link Rect: 143, 91, 151, 103 ActionDest: 282 Annotation: Subtype: Link Rect: 222, 91, 229, 103 ActionDest: 293 Page: Sequence: 12 Annotations: Annotation: Subtype: Link Rect: 249, 591, 256, 603 ActionDest: 282 Annotation: Subtype: Link Rect: 300, 301, 307, 313 ActionDest: 282 Annotation: Subtype: Link Rect: 146, 166, 153, 178 ActionDest: 293 Annotation: Subtype: Link Rect: 106, 153, 113, 165 ActionDest: 293 Annotation: Subtype: Link Rect: 367, 99, 374, 111 ActionDest: 282 Page: Sequence: 13 Annotations: Annotation: Subtype: Link Rect: 196, 538, 203, 550 ActionDest: 293 Annotation: Subtype: Link Rect: 154, 444, 161, 453 ActionDest: 325 Annotation: Subtype: Link Rect: 162, 444, 174, 453 ActionDest: 343 Annotation: Subtype: Link Rect: 177, 444, 189, 453 ActionDest: 343 Annotation: Subtype: Link Rect: 123, 376, 135, 385 ActionDest: 343 Annotation: Subtype: Link Rect: 112, 349, 124, 358 ActionDest: 343 Annotation: Subtype: Link Rect: 125, 349, 137, 358 ActionDest: 343 Page: Sequence: 14 Annotations: Annotation: Subtype: Link Rect: 118, 295, 125, 303 ActionDest: 325 Annotation: Subtype: Link Rect: 467, 294, 479, 303 ActionDest: 343 Annotation: Subtype: Link Rect: 479, 294, 491, 303 ActionDest: 343 Page: Sequence: 15 Annotations: Annotation: Subtype: Link Rect: 436, 559, 473, 570 Annotation: Subtype: Link Rect: 419, 533, 457, 544 Annotation: Subtype: Link Rect: 126, 443, 331, 454 Annotation: Subtype: Link Rect: 395, 339, 433, 350 Annotation: Subtype: Link Rect: 250, 314, 288, 325 Annotation: Subtype: Link Rect: 450, 288, 487, 299 Annotation: Subtype: Link Rect: 174, 249, 212, 260 Annotation: Subtype: Link Rect: 203, 159, 241, 170 Annotation: Subtype: Link Rect: 495, 133, 519, 144 Annotation: Subtype: Link Rect: 97, 120, 293, 131 Page: Sequence: 16 Annotations: Annotation: Subtype: Link Rect: 372, 727, 410, 738 Annotation: Subtype: Link Rect: 318, 585, 519, 596 Annotation: Subtype: Link Rect: 97, 572, 157, 583 Annotation: Subtype: Link Rect: 406, 482, 519, 493 Annotation: Subtype: Link Rect: 97, 469, 306, 480 Annotation: Subtype: Link Rect: 126, 443, 303, 454 Annotation: Subtype: Link Rect: 319, 430, 519, 441 Annotation: Subtype: Link Rect: 97, 417, 195, 428 Annotation: Subtype: Link Rect: 407, 391, 445, 402 Annotation: Subtype: Link Rect: 472, 378, 509, 390 Annotation: Subtype: Link Rect: 330, 301, 368, 312 Annotation: Subtype: Link Rect: 388, 159, 426, 170 Annotation: Subtype: Link Rect: 76, 78, 166, 109 Annotation: Subtype: Link Rect: 234, 72, 424, 83 Checksum: 20d4e6ca Type: CRC32 Checksum: 2c7430287709b8d63b5257dc69d04ba2 Type: MD5 Checksum: ad3602ed81a718b26ff278a086948d5550bb7712 Type: SHA-1