Human Computer Interaction

An Investigation into the Evolution and Impacts of Human-Computer Interaction in Construction Hazard Detection

by Sangeeta Ramachandra Yadav*,

- Published in Journal of Advances and Scholarly Researches in Allied Education, E-ISSN: 2230-7540

Volume 19, Issue No. 4, Jul 2022, Pages 91 - 96 (6)

Published by: Ignited Minds Journals


ABSTRACT

In recent years, the multidisciplinary field of human-computer interaction has emerged as an exciting new area for study. The use of human-computer interaction to construction safety management has increased throughout the fourth industrial revolution, which has considerably aided the development of hazard detection in the construction sector. However, only a small number of researchers have thoroughly examined how human-computer interaction has evolved in the detection of building hazards. In this study, ACM Digital Library, Web of Science, Google Scholar, and Scopus were used to assess 274 relevant publications published between 2000 and 2021 in the field of human-computer interaction in construction hazard detection (CHR-HCI). Human-computer interaction has had a substantial impact on danger detection during the last two decades, according to the research. In addition, a number of new research areas have been created as a result of this work, Experiments that include multimodal physiological data analysis, intuitive gadgets and sensors as well as the development of a humancomputer interface safety management platform using big data are all included in this project. Virtual reality, ergonomics, computer vision, and computer simulation will be the emphasis of future research modules. In this work, we constructed a theoretical map that reflected the findings of previous studies and their connections, and for the future development of human-computer interaction in the field of threat detection, we gave guidance.

KEYWORD

human-computer interaction, construction safety management, hazard detection, building hazards, ACM Digital Library, Web of Science, Google Scholar, Scopus, multimodal physiological data analysis, intuitive gadgets, sensors, human-computer interface, big data, virtual reality, ergonomics, computer vision, computer simulation, theoretical map, threat detection

INTRODUCTION

Artificial intelligence (AI) is used to a system in machine learning (ML), where the system learns from its prior experiences without being explicitly programmed. Its main objective is to learn on its own, without assistance from humans, and to change how the systems behave. Systems use a number of models for learning. Using data streams produced by ubiquitous devices, these models may be created to learn online. This process is known as stream learning or online learning. In a process known as offline learning, models may also pick up new information from prior data. One of the issues in computer-related applications that is expanding and gaining popularity most quickly is the integration of online data systems. Thanks to recent developments in communication technology, entities may communicate with one another. Entities are capable of listening, responding, and communicating with one another as well as with their environment. By 2020, it is anticipated that between 25 and 50 billion internet-connected gadgets will be in use for a variety of purposes. [1] Actuators and sensors are put in the outside world to sense parameters in Internet data. Through communication networks, these devices talk to one another. The same network is used at the collecting centers to provide the measured parameters as raw data. Given that the internet has grown to be one of the most significant sources of new data and raw data, data science offers a fresh and significant opportunity to improve the intelligence of online data applications.

LITERATURE REVIEW

Yang, J., et al. (2013) present Mem-Brain, a unique method that combines related mutations with several machine learning classifiers to identify trans-membrane inter-helix connections from amino acid sequences. Mem-Brain outperforms the best method currently available in the literature by 12.5 percent, attaining an average accuracy of 62% when tested on 60 non-redundant polytopic proteins using a stringent cross-validation approach that leaves one out. For 13 recently solved G protein-coupled receptors, the Mem-Brain contact predictions boosted the transmembrane TM-score of I-TASSER models by 37% when they were used. In the absence of all G protein-coupled receptor templates and homologous templates with sequence identity more than 30%, the number of foldable occurrences (TM-score >0.5) rose by 100%. Progress in contact prediction has been made, which suggests structural models of transmembrane proteins could be contact-driven. Adhav, K., Gawali, S.Z., and Murumkar, R. (2014) demonstrate the potential applications of several the past, word of mouth advertising for products was only allowed between individuals. Traditional marketing strategies move away from in-person contacts and toward online reviews as public relations technology develops. These online reviews serve as valuable input for both clients and service providers or enterprises. Making decisions on the caliber of goods or services is made easier with the help of these reviews. For marketing choices, service or product performance assessments, and improvement, businesses or suppliers use opinions. However, not all users or customers publishing reviews have the same objectives in mind. It's possible for reviews to be created to either praise or mock a product. Determining how many reviews are spam and how many are genuine is essential. Deceptive reviews, non-reviews, and brand-specific evaluations are just a few examples of the many different types of spam reviews. A single person or a group of people, known as a group reviewer, may write a review. Behjat A.R. et al. (2013) provide a particle swarm optimization (PSO) based feature selection method that decreases dimensionality while enhancing spam email classification precision. When fish or birds gather in groups, PSO mimics their social behaviour. The optimal feature subsets are found by scanning the feature space using a PSO-based feature selection technique. The high dimensionality of the feature selection process and the low classification accuracy of spam emails are to blame for the problems with an email spam detection system. A global optimization issue known as feature selection (FS) in machine learning reduces unnecessary and undesired data while providing a set of acceptable outcomes with high accuracy. On the other hand A fitness function dictates the rate of evolution of the selection feature. Ling-Spam and Spam Assassin databases are used to evaluate classifier performance and feature vector length as inputs to classifiers. Using the PSO-based feature selection strategy, the researchers were able to obtain great feature selection outcomes with the fewest number of selected features due to the high accuracy of spam email classification using the Multi-Layer Perceptron (MLP) classifier. Ott, M., et al. (2011) In this study, we explore misleading opinion spamfalse views that have been deliberately created to seem realcases of opinion spam that can be recognized by humans. Online ratings, reviews, and product research are all growing trends among consumers. As a consequence, websites with user reviews are increasingly being targeted by opinion spam. We create and evaluate three methods for spotting bogus opinion spam, On our gold-standard opinion spam dataset, a classifier developed using the work of computational linguistics and psychology was able to correctly classify more than 90% of the spam. On the basis of feature analysis of our learned models, we also provide a number of theoretical advances, such as establishing a The results of Fei et al. (2013) and human assessment indicate that the suggested approach outperforms reliable baselines, proving the strategy's utility. This opens the door for us to establish a network of reviewers who submit their work in spurts. Using a Markov Random Field (MRF) and the Loopy Belief Propagation technique (LBP), the next step is to assess whether a reviewer in the network is a spammer or not. We also provide a variety of features and make use of feature-induced message forwarding in the LBP framework for network inference. Additionally, based on supervised classification of their reviews, we provide a special evaluation method for automatically rating spammers that have been found. Additionally, we work with domain experts to do a human evaluation of the identified spammers and non-spammers.

METHOD AND DATA ANALYSIS

We used electronic mail to send out surveys to participants in order to get data regarding the use of ML in HCI work. The survey was based on a standardized methodology with five sections, numbered I through V. We employed sections I through III to record details about the location, task, and domain of HCI application usage by participants. The usage of ML in HCI work was recorded in Parts IV and V. Respondents had the option to explain why they have not employed machine learning in their HCI work in part V. A small team of HCI professionals gave the protocol's preliminary version a thorough analysis. Throughout this process, a number of ML and HCI-related topics were explained and improved. In the protocol, it is clear that neither ML approaches nor HCI areas of interaction, tasks or application domains are orthogonal. However, individuals who work in ML or HCI distinguish between ML approaches and aspects of HCI work using comparable concepts, and the protocol perpetuates this prejudice or reality. FTP access to the protocol and raw survey data is available at ftp.ics.forth.gr/pub/machine learning. The protocol is included in the file survey96.txt, while the raw survey answer data is contained in the file survey96.xls.

PART I: AREA OF HCI INVOLVEMENT

We identified eight distinct HCI engagement areas and asked respondents to choose which ones they were most actively interested in. Table 1 gives a summary of the replies. The majority of respondents chose user interface design and assessment. The majority of the unique comments (17) were from the same place (Table 1). Our contingency matrix provides 2'2 interactions between areas since several respondents claimed that they were active in various HCI areas multiple times. Table 2 presents an overview of the outcomes of the contingency.

service design and assessment, user interface design and evaluation, and education, training, and intelligent tutoring systems (ITS). 2. Only 25 respondents claimed they were involved in just one area. However, UI was chosen by 17 out of 25 people, or 68 percent, of those who made just one choice. Even when coupled with other areas, UI still remains the primary HCI participation; see Table 2.

Table 1. Areas of HCI Involvement

3. As can be seen from Table 1's OTH item, we only missed 9% of the replies that were sent.

PART II: HCI TASK INVOLVEMENT

Indicative HCI exercises were added in the questionnaire's second section. Respondents were asked to indicate which duties in their professional or academic career they are most invested in. The distribution of the replies is shown in Table 3. It was suggested to the respondents to choose as many sections as they felt were required. Per respondent, an average of 4.90 tasks were chosen. We deliberately avoided making an orthogonal list of activities in order to make the survey participants' lives easier. People often use many names to refer to the same subject. Usability engineering (UE), user modelling (UM), creating and assessing multimedia systems (MU), and modelling were the most often occurring tasks.

Table 2. Interdependence of HCI's many facets

Entries show concurrent participation in two different areas. For instance, 51 replies that indicated participation in both product design and user interface design (UI) were obtained (PS). For an explanation of the acronyms, see Table 1.

Table 3. Involvement in various parts of the HCI job

Each respondent had the option to pick several tasks. 4.90 tasks are completed on average by each respondent. There are 560 respondents and tasks total. Cognitive behavior (CB), followed by information retrieval, is the task abbreviation (IR). They represent more than 60% of all responses taken together. Few significant interactions between tasks were found by contingency analysis of answers (see Table 4). In order to achieve the highest level of adaptability and system optimization, user modelling (UM), usability engineering (UE), and multimedia system design and assessment (AD) were all used together (MU). Additionally, there are significant correlations between MU and information retrieval, AD and UE, UM and cognitive behavior modeling (CB), and UM and MU (IR). On the other hand, a number of other activities within the overall universe of tasks managed to attain quite modest contingency interaction. This multidisciplinary approach may be seen in Tables 3 and 4. Supporting such job with ML or any other technological source is not an easy task.

PART III: HCI APPLICATION INVOLVEMENT

The final section of the survey asked about respondents' application demographics. Table 5 provides a summary of the replies. Participants had the option of choosing more than one HCI application area. Table 3 lists the task abbreviations for education, training, and public. Rows having a contingency less than or equal to ten are excluded from the calculation. Sector, media, and aviation/aerospace are the most active HCI application domains. An average of 1.88 application domains were participated in by each responder. The public sector, education/training, and media/entertainment sectors all attained their maximum levels of contingency, as did the public sector and media/entertainment. Additional than 8, there were no other contingencies. However, comments about application involvement are consistent with those for HCI task and involvement area. They give a comprehensive view of HCI work and research as a whole.

PART IV: EXPERIENCE AND USE OF MACHINE LEARNING IN HCI WORK

Section 4 of the questionnaire questioned respondents how often they used ML in their HCI work and how much they knew about alternative ML paradigms, and their level of happiness with ML. In a variety of ML paradigms, we asked participants to judge their own performance. Earlier work on ML research and application categorization provided the inspiration for the paradigms. Regardless of their degree of ML competence, we also asked participants to say if they had utilized machine learning in their work and to name the various ML paradigms they had used. We asked respondents to grade themselves on a discrete seven-point scale using the following categories: There are three levels of familiarity: none, some knowledge, and some information that has been applied or extensively studied at least once. To map out the distances between locations, we used intermediate points. We provide a summary in Table 6. Out of 112 participants, 41 acknowledged utilizing or currently employing machine learning in their job. Table 6 shows how often the 41 ML users used each of the ML paradigms. Users of ML, on the other hand, seldom adhere to a single paradigm. Table 7 presents the results of two contingency analyses and estimates of the frequency of ML use, which demonstrate that each respondent has used an average of 2.3 paradigms. Contingency analysis across ML paradigms used in HCI work shows the substantial roles that neural networks (NNL), statistical learning methods (SL), rule induction (RI), and case-based learning (CBL) have played in the construction of HCI-ML applications.

Table 6. Understanding of machine learning concepts and the regularity with which ML paradigms are used

The responses are scored on a seven-point discrete scale, with 1 indicating complete unfamiliarity (with the related ML paradigm) and 7 denoting extraordinary familiarity (with the paradigm). The average values are accompanied by estimates of the standard deviation. 2.20 is the average contingency. Table 6 introduces abbreviations. There are no missing entries. Inductive logic programming (ILP) is a major improvement since it provides the user with advanced knowledge representation, inference, and learning processes and is expected to enable application development in the future. ML knowledge scores were not particularly high on average; they varied from 2.3 for inductive logic programming to a minimum of 2.3 for reinforce-ment learning, conceptual clustering, and neural networks (NNL) (ILP). Average rating, however, masks people' true ML abilities. A distinct image appears if we average numbers using the highest evaluations for each participant. In any case, we shouldn't expect responders to be masters of every ML paradigm. In fact, this isn't even true among ML researchers, according to a study by Moustakis et al. So we took the top evaluations from each participant, regardless of whether they had or had not used ML in HCI work, and averaged them over all ML paradigms and responders. The approach's average rating was 4.8 1.5, which is approximately the same as the rating for using it at least once or doing extensive study on it.

Table 7. Relationship between the highest degree of ML awareness and the use of ML in HCI research or work

If you're familiar with machine learning, we recommend using a threshold of 4, which is halfway between knowing a little bit and having done extensive research on the topic. As a whole, the number of respondents (N = 112) and their responses to the survey are correlated. individuals who have at least a basic understanding of the ML paradigms. On the other hand, ML usage in HCI work seems to have been affected by good ratings for at least one ML paradigm. By using the number 4 as a criterion (which sits between the knowledge levels "has some knowledge of" and "used it at least once or studied extensively"), we were able to determine that 40 out of the 41 ML users had ML skills that were above the cutoff point. There was a wide range in the average degree of familiarity

machine learning (ML) at a level of 4 or above, they had not yet used ML in their HCI work. Also included in this component of the questionnaire was a satisfaction rating for those who have used ML in HCI research. It was determined by a five-point scale: 1 poor, 2 little, 3 good; 4 excellent; 5 excellent. There is an average level of satisfaction for all ML users of 3.3, which is greater than the a goodo norm.

PART VI: WHY ML HAS NOT BEEN USED IN HCI WORK

Finally, respondents were asked to explain why they did not employ machine learning in their job. Respondents were invited to choose as many justifications from a selection of five options as they needed. There were three primary reasons given by people who didn't utilise ML in their HCI work: a lack of awareness that ML may be beneficial to their job, or a lack of success stories from other fields that were comparable to their own. In fact, examination of the interrelationships between the reasons for nonusewhich aren't detailed here for the purpose of brevityfound a substantial interaction between the aforementioned elements. We opted to continue guided analysis once descriptive analysis of survey data was finished in accordance with the following study questions:

DO USERS OF ML DIFFER FROM NONUSERS?

AutoClass generated three classes from 112 binary data vectors including 21 attributes, concentrating on HCI task engagement and clustered answers, to examine the differences between ML users and nonusers. Activity-related attributes were valued as either yes when the respondent demonstrated participation with the task or no when they weren't. Due to the fact that duties are universal and apply to all HCI activity, independent of industry or application domain, we choose to concentrate just on them (see Tables 3 and 5, respectively). To prevent skewing the outcomes, the usage or nonuse of ML was not taken into account. The procedure culminated in the creation of classes A, B, and C. Table 10 summarises our findings. Case-based reasoning emerged as the most significant task or characteristic in the formation of a class.

Table 8. Term influence values across classes

Influence values provide a rough estimate of each attribute's relative weight when differentiating classes from the entire data set. The values are standardized globally. The number in parenthesis indicates the proportion of each class's responses. It seems there are no omissions. the CB model, the CE model, the EC model, the CL model, and the Table 10 model of cognitive behaviour. This finding is consistent with the survey's intent to connect ML usage in HCI work since leading qualities are intelligent activities that are often linked with the use of ML and are not limited to HCI work and research alone. These activities had the most effect on class formation while being tangential to HCI. Table 10 additionally includes influence values for each class. No single task had a significant impact on either class A or class b, but a collection of tasks had a significant impact on class C formation. Classes A and B account for almost equal shares of the ML users in the HCI work; class A included 18 ML users, class B included 21, and class C included 2 users. Machine learning (ML) and traditional methods were shown to be equally effective in class creation. There were no effects or interactions at the a = 0.05 level in repeated two-tailed paired t-tests of means utilising HCI tasks, HCI areas of application, and HCI areas of participation data. No trends were found in either the CN2 or C4.5 models that could be linked to the use or nonuse of ML, despite the relatively high statistical correctness of learned rules. For example, by adding machine learning (ML) skills to the list of attributes, we were able to conduct trials using the same data as AutoClass with CN2 and C4.5.

CONCLUSION

The application of machine learning (ML) in HCI work was identified and modelled using a systematic survey that served as the foundation for this study. We have developed some important early findings as a result of the analysis of 112 replies from top HCI experts, particularly the following. Many HCI professionals (from both business and academia) are quite familiar with and informed with ML. Over a third of HCI professionals have admitted to utilizing using machine learning (ML) is not an easy process. Since HCI work is synthetic, ML application is required. This is a significant barrier for ML, which must develop enough before it can play well in artificial games. It will also need efficient process models, which will result in an action plan that is suitable for the current predicament. A significant portion of survey respondents, like just under two-thirds, do not employ ML in their HCI work. The text reports a few examples of these arguments. The idea that machine learning is not essential, the major reasons for this are a dearth of real-world examples and an ignorance of the possibilities. In reality, as seen in Table 15 contingency matrix, these causes interact with one another. Leading correlations between misconception and a lack of specific case studies and awareness are these two. To get beyond these obstacles, individuals should attempt to spread the word about their projects and scholars from both domains should work together to enhance ML pedagogy. A few years back,

REFERENCES

1. Yang, J., et al. (2013) High-accuracy prediction of transmembrane inter-helix contacts and application to GPCR 3D structure modeling, Bioinformatics, Pp. 1-6. 2. Adhav, K, Gawali, S.Z. and Murumkar, R. (2014) Survey on Online Spam Review Detection Methods, International Journal of Computer Science and Information Technologies, Vol. 5, Np. 6, Pp.7875-7876. 3. Behjat A.R., et al. (2013) A PSO-Based Feature Subset Selection for Application of Spam /Non-spam Detection, Noah S.A. et al. (eds) Soft Computing Applications and Intelligent Systems, Springer Communications in Computer and Information Science, Vol 378, Pp. 183-193. 4. Ott, M.,et al. (2011) Finding deceptive opinion spam by any stretch of the imagination, Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Vol.1, Pp. 309-319. 5. Fei, et al. (2013) Exploiting Burstiness in Reviews for Review Spammer Detection, ICWSM, Vol. 13, Pp. 175-184. 6. M. Jethanandani, A. Sharma, T. Perumal, and J.-R. Chang (2020) ―multi-labelclassification-based ensemble learning for human activity recognition in smart home,‖ Internet of Things, vol. 12, p. 100324, 2020. 7. Subasi, (2018) ―Sensor based human activity recognition using adaboost ensemble 8. M. Jethanandani, A. Sharma, T. Perumal, and J.-R. Chang (2020) ―multi-labelclassification-based ensemble learning for human activity recognition in smart home,‖ Internet of Things, vol. 12, p. 100324, 2020. 9. Subasi, (2018) ―Sensor based human activity recognition using adaboost ensemble classifier,‖ procedia computer science, vol. 140, pp. 104–111, 2018. 10. F. Anowar, S. Sadaoui, and B. Selim (2021) ―Conceptual and empirical comparison of dimensionality reduction algorithms (pca, kpca, lda, mds, svd, lle, isomap, le, ica, t-sne),‖ Computer Science Review, vol. 40, p. 100378, 2021. 11. L. Atzori, A. Iera, and G. Morabito (2010) ―The internet of things: A survey,‖ Computer networks, vol. 54, no. 15, pp. 2787–2805, 2010. 12. M. J. Ismail, R. Ibrahim, and I. Ismail (2011) ―Adaptive neural network prediction model for energy consumption,‖ in 2011 3rd International Conference on Computer Research and Development, vol. 4. IEEE, 2011, pp. 109–113. 13. Adnan Mukattash et al. (2011) "Optimal Computerized Model for Designing Cellular Manufacturing Systems using Neural Network‖, Volume 11, Issue 15, Page No. 2837-2842, DOI: 10.3923/jas.2011.2837.2842 14. Patil, M.S. and Bagade, A.M. (2012) Online Review Spam Detection using Language Model and Feature Selection, International Journal of Computer Applications, Vol. 59, No. 7, Pp. 0975-8887. 15. Prajapati, J., Bhatt, M. and Prajapati, D. J. (2012) Detection and summarization of genuine review using Visual Data Mining, International Journal of Computer Applications, Vol. 43, No. 11, Pp. 22-26.

Corresponding Author Sangeeta Ramachandra Yadav*

Faculty Head, Computer Science and Applications, S M Joshi College, Hadapsar, Pune-28