The Mining Industry has changed significantly in recent decades with the introduction of advanced technologies such as Artificial Intelligence (AI) and Machine Learning (ML). These innovations contribute to the creation of expert systems that help in optimizing processes, increasing the safety and sustainability of operations. This article is a literature review of modern AI and ML methods and technologies used in the Mining Industry. Discusses various intelligent and expert systems used to improve productivity, reduce operating costs, improve occupational safety, environmental sustainability, machine automation, predictive analytics, quality monitoring and control, and inventory and logistics management. The advantages and disadvantages of different approaches are analyzed, as well as their potential impact on the future of the Mining Industry. The review highlights the importance of integrating AI and ML into mining processes to achieve more efficient and safer solutions.

Many clinical research datasets have a large percentage of missing values that directly impacts their usefulness in yielding high accuracy classifiers when used for training in supervised machine learning. While missing value imputation methods have been shown to work well with smaller percentages of missing values, their ability to impute sparse clinical research data can be problem specific. We previously attempted to learn quantitative guidelines for ordering cardiac magnetic resonance imaging during the evaluation for pediatric cardiomyopathy, but missing data significantly reduced our usable sample size. In this work, we sought to determine if increasing the usable sample size through imputation would allow us to learn better guidelines. We first review several machine learning methods for estimating missing data. Then, we apply four popular methods (mean imputation, decision tree, k-nearest neighbors, and self-organizing maps) to a clinical research dataset of pediatric patients undergoing evaluation for cardiomyopathy. Using Bayesian Rule Learning (BRL) to learn ruleset models, we compared the performance of imputation-augmented models versus unaugmented models. We found that all four imputation-augmented models performed similarly to unaugmented models. While imputation did not improve performance, it did provide evidence for the robustness of our learned models.

The continuous expansion of Large Language Models (LLMs) has significantly transformed the fields of artificial intelligence (AI) and natural language processing (NLP). This paper reviews the rapidly evolving domain of language models and introduces the concept of Extremely Large Language Models (XtremeLLMs), a new category defined for models exceeding one trillion parameters. These models are monumental in scale and engineered to enhance performance across a diverse range of language tasks. This study aims to establish a comprehensive framework that explores the significant opportunities and complex challenges presented by such extensive scaling and emphasises the implications for future advancements in the field.

Highly flexible manufacturing systems require continuous run-time (self-) optimization of processes with respect to various parameters, e.g. efficiency, availability, energy consumption etc. A promising approach for achieving (self-) optimization in manufacturing systems is the usage of the context sensitivity approach. Thereby the Cyber-Physical Systems play an important role as sources of information to achieve context sensitivity. In this paper it is demonstrated how context sensitivity can be used to realize a holistic solution for (self-) optimization of discrete flexible manufacturing systems, by making use of Cyber-Physical System integrated in manufacturing systems/processes. A generic approach for context sensitivity, based on self-learning algorithms, is proposed aiming at a various manufacturing systems. The new solution is propos encompassing run-time context extractor and optimizer. Based on the self-learning module both context extraction and optimizer are continuously learning and improving their performance. The solution is following Service Oriented Architecture principles. The generic solution is developed and then applied to two very different manufacturing processes. This paper proposes a holistic solution to achieve context sensitivity for Flexible Manufacturing Systems, whereby the knowledge created by applying the context sensitivity approach can be used for (self-) optimization of manufacturing processes.

The Distributed eLearning Center (DeLC) is a portal, providing extensive support in the day-to-day work when it comes to e-learning content – it helps students and teachers organize their learning materials, fill the gaps in knowledge (for students) and educational approaches (for teachers), organize and conduct exams, and overall, with providing proactive and personalized e-learning environment. The scope of DeLC as a project involves many extensions, covering the aspects of learning, teaching, exams, and collecting statistical information. Such extension is an agent-oriented environment, which enriches the functionalities with intelligent components, that are reactive and proactive, referred to as agents or assistants. This paper is focused on presenting the latest step in the evolution of FraudDetector software agent, which started with base functionality for fraud detection, and now it aims at usage of AI to accomplish its tasks, taking advantage not only from its knowledgebase, but from a much larger one, used by ChatGPT – through integration with it, which is the main contribution of this research, although the real results from production environment are still pending. In this process, agent’s architecture should stay open for collaboration with another external AI provider if necessary, trying to decouple the components, responsible for integration. As of now, the experiments show that involving ChatGPT in FraudDetector’s functionality enriches it and the agent’s precision could be improved this way.

Recurrent Neural Networks (RNNs) have significantly advanced the field of machine learning by enabling the effective processing of sequential data. This paper provides a comprehensive review of RNNs and their applications, highlighting advancements in architectures such as Long Short-Term Memory (LSTM) networks, Gated Recurrent Units (GRUs), Bidirectional LSTM (BiLSTM), and stacked LSTM. The study examines the application of RNNs in different domains, including natural language processing (NLP), speech recognition, financial time series forecasting, bioinformatics, autonomous vehicles, and anomaly detection. Additionally, the study discusses recent innovations, such as the integration of attention mechanisms and the development of hybrid models that combine RNNs with convolutional neural networks (CNNs) and transformer architectures. This review aims to provide machine learning researchers and practitioners with a comprehensive overview of the current state and future directions of RNN research.

In the face of escalating climate concerns and the push for sustainable development, the global shift towards renewable and decentralized energy systems presents new challenges and opportunities. This study investigates integrating decentralized energy production, particularly photovoltaic (PV) systems, into national energy planning, aiming to optimize energy strategies that balance local production and consumption with national objectives. By analyzing the Swiss energy model, the research employs the EnergyScope and REHO models to assess the strategic implications of decentralized versus centralized energy systems. Results show that a decentralized approach can significantly reduce PV installation needs to 35 GW, about 23% of potential capacity, and decrease annual system costs by 10% to CHF 1230 per capita. This strategy emphasizes local consumption, minimizes grid reinforcement demands, and leverages economic advantages while addressing overproduction challenges through effective energy storage and grid management. Conclusions underline the strategic value of combining centralized and decentralized methods for resilient and sustainable energy planning. The study contributes to the discourse on energy policy and infrastructure planning, advocating for a hybrid model that accommodates both local conditions and broader energy objectives, urging further research into climate impacts and technology integration for a comprehensive energy future.

The IEEE 802.11ah standard is introduced to address the growing scale of Internet of Things (IoT) applications. To reduce contention and enhance energy efficiency within the system, the restricted access window (RAW) mechanism is introduced at the medium access control (MAC) layer to manage the significant number of stations accessing the network. However, the RAW parameters need to be appropriately determined to achieve optimal network performance. In this paper, we optimize the configuration of RAW parameters in the IEEE 802.11ah-based IoT network. We analyze and propose an RAW parameters optimization problem with the objective of improving network throughput and formulate it as a Markov decision process. To cope with the complex and dynamic network conditions, we propose a proximal policy optimization (PPO)-based deep reinforcement learning (DRL) algorithm to find the optimal RAW parameters. We construct network environments with periodic and random traffic in the NS-3 simulator to validate the performance of the proposed PPO-based RAW parameters optimization algorithm. Simulation results reveal that using the PPO-based DRL algorithm, optimal RAW parameters can be obtained under different network conditions, thereby significantly improving network throughput.

Online education allows learners to develop knowledge and skills flexibly and conveniently—such observation among students whose characteristics involve student engagement, self-regulation, and self-efficacy. However, studies to characterize Filipino online learners seem lacking. Thus, this study aimed to characterize science education tertiary students in the Philippines concerning their online student engagement (OSE), self-regulated learning (SRL), and online learning self-efficacy (OLSE). The unprecedented events brought by COVID-19 pandemic also urged the implementation of online modalities while there is no available information on students’ online learning profiles. Hence, researchers used a survey research employed through ex post facto approach to determine the effects of the demographic profile on OSE, SRL, and OLSE. The survey was participated by N=373 respondents who answered the questionnaire with informed consent administered via Google Forms. Results revealed that OSE indicators moderately characterized students, while SRL and OLSE indicators are true of them, substantiated by the overall mean M=3.85(SD=0.90), M=3.86(SD=0.92), and M=3.14(SD=0.73), respectively. Also, multivariate tests showed no significant effect among the independent groups (p>0.05), except for gender and OLSE interaction (p<0.05) so, only in OLSE was a significant difference found in gender. In conclusion, Filipino online learners are moderate across aspects of student engagement, self-regulation, and self-efficacy.

I present a personal account of self-organizing systems. As such, it is necessarily biased and partial. Nevertheless, it should be useful to motivate useful discussions. The relevant contribution is not my attempts at answering questions (maybe all my answers are wrong), but the steps towards framing relevant questions to better understand self-organization, information, complexity, and emergence. With this aim, I start with a notion and examples of self-organizing systems (what?), continue with their properties and related concepts (how?), and close with applications (why?).

In this paper, we introduce a control method for the linear quadratic tracking (LQT) problem with zero steady-state error. It is achieved by augmenting the original system with an additional state representing the integrated error between the reference and actual outputs. In its essence, it is a linear quadratic integral (LQI) control embedded in a general LQT control framework, with the reference trajectory generated by a linear exogenous system. During the simulative implementation for the specific real-world system Car-in-the-Loop (CiL) test bench, we assume that the 'real' system is completely known. Therefore, for the model-based control, we can have a perfect model identical to the 'real' system. It becomes clear that stable solutions can scarcely be achieved with controller designed with the perfect model of the 'real' system. Contrary, we show that a model learnt via Bayesian Optimization (BO) can facilitate a much bigger set of stable controllers. It exhibits an improved control performance. To the best of the authors' knowledge, this discovery is the first in the LQT related literature.

In this paper, we present a multi-task model that predicts disparities and confidence levels in deep stereo matching simultaneously. We do this by combining its successful model for each separate task and obtaining a multitask model that can be trained with a proposed loss function. We show the advantages of this model compared to training and predicting disparity and confidence sequentially. This method enables an improvement of 15% to 30% in the area under the curve (AUC) metric when trained parallel rather than sequential. In addition, the effect of weighting the components in the loss function on the stereo and confidence performance is investigated. By improving the confidence estimate, the practicality of stereo estimators for creating distance images is increased.

X-ray Fluorescence Computed Tomography (XFCT) is an emerging non-invasive imaging technique providing molecular-level data, gaining attention for high-resolution imaging. However, increased sensitivity with benchtop X-ray sources raises radiation exposure. Artificial Intelligence (AI), particularly deep learning (DL), has revolutionized medical imaging by delivering high-quality images in the presence of noise. In XFCT, traditional methods rely on complex algorithms for noise reduction, but AI holds promise in addressing high-dose concerns. We present an optimized SCUNet model for noise reduction in low-concentration XRF images. Compared to higher-dose images, our method’s effectiveness is evaluated. While various denoising techniques exist for X-ray and CT, few address to XFCT. The DL model is trained and assessed using the augmented data, focusing on background noise reduction. Image quality is measured using PSNR and SSIM, comparing outcomes with 100% X-ray dose images. Results show the proposed algorithm achieves high-quality images from low-dose and low-contrast agents, with a maximum PSNR of 39.05 and SSIM of 0.86. The model outperforms BM3D, NLM, DnCNN, and SCUNet in both visual inspection and quantitative analysis, particularly in high-noise scenarios. This indicates the potential of AI, specifically the SCUNet model, in significantly improving XFCT imaging by mitigating the trade-off between sensitivity and radiation exposure.

The vast majority of autonomous driving systems are limited to applications on roads with clear lane markings and are implemented using commercial grade sensing systems coupled with specialized graphic accelerator hardware. This research reviews an alternative approach for autonomously steering vehicles that eliminates the dependency on road markings and specialized hardware. A combination of machine vision, machine learning and artificial intelligence based on popular pre-trained Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN) was used to drive a vehicle along roads lacking lane markings (unmarked roads). The team developed and tested this approach on the ACTor (Autonomous Camus TranspORt) vehicle - an autonomous vehicle development and research platform coupled with a low-cost webcam based sensing system and minimal computational resources. The proposed solution was evaluated on real-world roads and varying environmental conditions. It was found that this solution may be used to successfully navigate unmarked roads autonomously with acceptable road following behavior.

The use of didactic and interactive materials is essential in generating interest among students and teachers in utilizing mathematical models and digital technologies for the educational process. These materials create a dynamic and engaging learning environment that promotes a deeper understanding of complex concepts and fosters a passion for learning. Additionally, integrating interactive materials into pilot courses can assist teachers in better assessing student learning and adjusting the teaching strategies accordingly and the teachers can receive valuable insights into students' strengths and weaknesses, allowing them to provide targeted support and intervention when needed. In this context, the purpose of this paper is to introduce an approach for solving mathematics problems embedded in technical scenarios within the defense and security fields with the aid of digital technology. In this way, students can visualize abstract concepts, experiment with different scenarios, and receive instant feedback on their understanding. This paper helps to reinforce key concepts and enhance problem-solving skills, sparking curiosity, creativity, and encouraging active participation and collaboration. Throughout the development of this proposal, good practices are adopted, and advice for improvement is collected while having a wide range of users, giving feedback, discussions, and testing (pilot) short-term learning/teaching/training activities.

One of the oldest problems in physics is that of calculating the motion of N particles under a specified mutual force: the N-body problem. Much is known about this problem if the specified force is non-relativistic gravity, and considerable progress has been made by considering the problem in one spatial dimension. Here I review what is known about the relativistic gravitational N-body problem. Reduction to one spatial dimension has the feature that gravitational radiation is absent, thereby allowing for a clear comparison between the physics of one-dimensional relativistic and non-relativistic self-gravitating systems. After describing how to obtain a relativistic theory of gravity coupled to N point particles, I discuss in turn the 2-body, 3-body, 4-body, and N-body problems. Quite general exact solutions can be obtained for the 2-body problem, unlike the situation in general relativity in 3 spatial dimensions for which only highly specified solutions exist. The 3-body problem exhibits mild forms of chaos, and provides one of the first theoretical settings in which relativistic chaos can be studied. For N4 other interesting features emerge. Relativistic self-gravitating systems have a number of interesting problems awaiting further investigation, providing us with a new frontier for exploring relativistic many-body systems.

This paper describes a system that is used to gather data from Smart Home sensors measuring energy consumption, analyze and predict future consumption by using machine learning algorithm for prediction. It focuses on the architecture of the system as well as the need for such system to exist in practice – why the consumption should be measured at all and how that measurement can be put to good use for achieving energy efficiency.

Recent years have witnessed significant advances in reinforcement learning (RL), which has registered remarkable success in solving various sequential decision-making problems in machine learning. Most of the successful RL applications, e.g., the games of Go and Poker, robotics, and autonomous driving, involve the participation of more than one single agent, which naturally fall into the realm of multi-agent RL (MARL), a domain with a relatively long history, and has recently re-emerged due to advances in single-agent RL techniques. Although, typically, the communication protocol between agents is manually specified and not altered during training, recently, some papers have shown signs of trying to emerge a communication between agents on the one hand and, on the other hand, to understand what is exchanged between agents. So, there is a growing body of literature on this topic which includes qualitative and quantitative studies and the ones that apply mixed methods. This study presents the scoping review of the methodological strategies undertaken in a total of 16 research articles. The results present the critical appraisal of quantitative methods in terms of validity and reliability and for qualitative methods considering four trustworthiness factors. In the end, relevant insights are further explored with implications and reflections on how they can benefit one's research in the field.

The period of the COVID-19 pandemic resulted in a rapid development of innovative education methods, in particular using e-learning and remote work tools. The effects of this development are also post-pandemic changes in formal teaching regulations, in particular in higher education, allowing classes and lectures to be carried out with Blended Learning or Flipped Classroom methods. This paper provides information about a case study of implementing ICT technologies with elements of the mentioned methods in one of the subjects at a technical university. The implemented tools and solutions in the field of e-learning and interactivity are presented, along with information regarding their perception by students during two academic years in the post-COVID-19 period. The analysis of results of these information and student evaluations indicates their generally positive approach to such innovations in the educational path, and at the same time shows significant challenges for teachers to increase the attractiveness and effectiveness of the teaching process and the development of practical, technical skills of students.

Self-healing is the capability of materials to repair themselves after damage has occurred, usually by interaction between molecules or chains. Physical and chemical processes are applied for the preparation of self-healing systems. There are different approaches for these systems such as heterogeneous systems, shape memory effects, hydrogen bonding or covalent-bond interaction, diffusion and flow dynamics. Self-healing mechanisms can occur in particular by heat and light exposure or by reconnection without direct effect. The applications of these systems display an increasing trend in both R&D and industry sectors. Moreover, self-healing systems and their energy storage applications are currently getting great importance. This review aims to provide general information on recent developments in self-healing materials and their energy applications in view of the critical importance of self-healing systems for lithium-ion batteries (LIBs). In the first part of the review, an introduction about self-healing mechanisms and design strategies of self-healing materials is given. Then, selected important healing materials in the literature for the anodes of LIBs are mentioned in the second part. The results and future perspectives are stated in the conclusion section.

Video self-supervised learning (VideoSSL) offers significant potential for reducing annotation costs and enhancing a wide range of downstream tasks in video understanding. The ultimate goal of VideoSSL is to achieve human-level video intelligence across a spectrum of tasks, from low-level tasks such as pixel temporal correspondence to high-level complex spatio-temporal tasks like action recognition. However, most existing VideoSSL methods focus on isolated aspects of this spectrum and fail to integrate different levels of task complexity. Our study presents the first comprehensive survey that connects all families of VideoSSL methods. We provide a detailed review of the full spectrum of VideoSSL, from low to high levels, by conceptually linking their self-supervised learning objectives and including a comprehensive categorization. Our extensive evaluation highlights the strengths and limitations of each SSL objective across various downstream task families. We also detail the challenges in current VideoSSL research such as data curation, interpretability, deployment, and privacy concerns, an area that previous surveys have not thoroughly explored. In addressing these challenges, we recognize the strengths of existing methods in addressing these challenges and outline future directions for research.

This study is a synthesis of 159 articles that were selected for their relevance to comprehend key aspects of the Massive Open Online Courses (MOOCs) phenomenon, from a discourse analysis perspective. Since 2011, MOOCs are expanding worldwide so that the number of subscribers outpointed 101 million at the end of 2018. This paper explores the question whether the MOOCs are the embodiment of the global one-world classroom or whether, instead, they represent a low-cost alternative tailored to a segment that doesn´t have enough time or resources to attend a brick-and-mortar college. In addition, the review tackles the link between motivation and low completion rates. Finally, we discuss the need to devise better methods to assess the pedagogical value of MOOCs.

Systems biology has been established for more than a decade in the post-genomic era. With the help of the computational and mathematical tools, systems biology reconstitutes the entire scenario of the cell, tissue and even organism from the pieces data generated in the past decades. However, the modern biology is mainly focusing on the structure and function of the biomolecule, cell, tissue or organ, which are far from the essence of the life because of missing thermodynamic information. It is doubtable that the current systems biology-based omics is no-how to fully understand the dynamic courses of the structure, function and information in life. For this reason, we promote a novel concept of aquamoleculomics, in which the biological structure and function as well as thermodynamic characteristics and bioinformation of the aquamolecule complexes are included in this theoretical model of systems biology. Water is mother of life, matter and matrix of organism. Indeed, the fundamental roles of H₂O molecules in biological processes might be dramatically underestimated. Extremely speaking, H₂O networks in the living system might be engaged in all the biological processes including building all the biological structures, the residential places of the motherhood molecules as the honeycombs of honeybees.

This paper addresses the development of knowledge and assessment-centered learning approaches within a reflective learning framework in a first year physics class in a university faculty. The quality of students’ reflections was scored using a Self-reporting Reflective Learning Appraisal Questionnaire at the end of each learning approach. The results showed the differences between the approaches based on reflections on the learning control through self-knowledge, by connecting experience and knowledge, as well as through self-reflection and self-regulation. Assessment-centered activities fundamentally help students identify aspects of their attitudes towards, as well as regulate, their sustainability learning education.

Online learning is gaining massive popularity with time. The e-learning platforms operate differently from traditional educational institutions and hence need different strategy for course recommendations. This survey aims to cover the major emerging research areas in e-learning recommender systems. Our study covers different areas of research including graph-based methodologies, ITS, query optimization, content-based, and collaborative filtering, big data, and association rules mining. This survey aimed to explore all major emerging directions of recommender systems in education. This study analyzed existing literature in all of the areas mentioned before and performed objective-based analysis. A brief performance analysis was also done for the researches where the values were comparable. Limitations of existing researches were also identified and studied to shed some light on future directions.

Nowadays Air-Source Heat Pumps (ASHP) in combination with a Photovoltaic (PV) installation are a very promising option for a necessary and urgent energy transformation in European Union (EU). It is extremely important to develop solutions that will help maximize the use of energy generated from renewable energy sources (RES). Such issues include the problem of insufficient use of generated electricity in PV on-grid microinstallations in residential buildings. This paper's aim is to analyze the results of one-year-round operation of a PV array grid-connected hybrid installation with ASHP for domestic hot water (DHW) preparation in a residential building in Cracow, Poland in the context of increasing self-consumption (SC) of PV energy. Models of systems are built and simulated in Transient System Simulation Tool 18 (TRNSYS) software. Simulations were carried out for different scenarios involving different building electricity consumption profiles, PV system capacity and specified runtime management of ASHP. The novelty of this study lies in the evaluation of the impact of a certain range of conditions on the energy performance of the system, in particular on SC. The results showed that the use of ASHP, with specified runtime management, results in an increase in monthly SC values from 7 to 18%, and annual SC values up to 13%. Also determining the appropriate size of the used PV system depending on whether it is present ASHP in the installation is crucial to increase the value of the SC parameter. Overall, this study provides valuable insights into the potential benefits of PV panels and ASHP operating together, in particular on SC values.

Time-of-Flight (ToF) cameras are subject to high levels of noise and errors due to Multi-Path-Interference (MPI). To correct these errors, algorithms and neuronal networks require training data. However, the limited availability of real data has led to the use of physically simulated data, which often involves simplifications and computational constraints. The simulation of such sensors is an essential building block for hardware design and application development. Therefore, the simulation data must capture the major sensor characteristics. This work presents a learning-based approach that leverages high-quality laser scan data to generate realistic ToF camera data. The proposed method employs MCW-Net (Multi-Level Connection and Wide Regional Non-Local Block Network) for domain transfer, transforming laser scan data into the ToF camera domain. Different training variations are explored using a real-world dataset. Additionally, a noise model is introduced to compensate for the lack of noise in the initial step. The effectiveness of the method is evaluated on reference scenes to quantitatively compare to physically simulated data.

To better understand the shape memory materials and self-healing materials, a new series of liquid-crystalline shape memory polyurethane (LC-SMPU) composites, named SMPU-OOBAm, were successfully prepared by incorporating 4-octyldecyloxybenzoic acid (OOBA) into the PEG-based SMPU. The effect of OOBA on the structure, morphology and properties has been carefully investigated. The results demonstrate that SMPU-OOBAm have liquid crystalline properties, triple-shape memory properties and self-healing properties. The incorporated OOBA promotes the crystallizability of both soft and hard segments of SMPU, and the crystallization rate of the hard segment of SMPU decreases when the OOBA-content increases. Additionally, the SMPU-OOBAm forms a two-phase separated structure (SMPU phase and OOBA phase), and it shows two-step modulus changes upon heating. Therefore, the SMPU-OOBAm shows triple-shape memory behavior, and the shape recovery ratio decreases with an increase in the OOBA content. Finally, SMPU-OOBAm shows self-healing properties. The new mechanism can be ascribed to the heating-induced “bleeding” of OOBA in the liquid crystalline state and the subsequent re-crystallization upon cooling. This successful combination of liquid crystalline properties, triple-shape memory properties and self-healing properties make the SMPU-OOBAm composites with many promise applications in smart optical devices, smart electronic devices and smart sensors.

The construction of molecular robotic-like objects that imitate living things is an important challenge for current chemists. Such molecular devices are expected to perform their duties robustly to carry out mechanical motion, process information, and make independent decisions. Dissipative self-organization plays an essential role in meeting these purposes. To produce a micro-robot that can perform the above tasks autonomously as a single entity, a function generator is required. Although many elegant review articles featuring chemical devices that mimic biological mechanical functions have been published recently, the dissipative structure, which is the minimum requirement, has not been sufficiently discussed. This article aims to show clearly that dissipative self-organization is a phenomenon involving autonomy, robustness, mechanical functions, and energy transformation. Moreover, the author details the recent experimental results of an autonomous light-driven molecular device that achieves all of these features. In addition, a chemical model of cell-amplification is also discussed to focus on the generation of hierarchical movement by dissipative self-organization. By reviewing this research, it may be perceived that mainstream approaches to synthetic chemistry have not always been appropriate. In summary, the author proposes that the integration of catalytic functions is a key issue for the creation of autonomous microarchitecture.

Prochlorococcus, a cyanobacteria genus of the smallest and most abundant oceanic phototrophs, encompasses ecotype strains adapted to high-light (HL) and low-light (LL) niches. To elucidate the adaptive evolution of this genus, we analyzed 40 Prochlorococcus marinus ORFeomes, including two cornerstone strains, MED4 and NATL1A. Employing deep learning with robust statistical methods, we detected new protein family distributions in the strains and identified key genes differentiating HL and LL strains. HL strains harbor genes (ABC-2 transporters) related to stress resistance, such as DNA repair and RNA processing, while LL strains exhibit unique chlorophyll adaptations (ion transport proteins, HEAT repeats). We report variable, depth-dependent endogenous viral elements in the 40 strains. We constructed the ORFeomes of MED4 and NATL1A covering 99 % of the annotated protein-coding sequences of the two species, totaling 3976 cloned, sequence-verified ORFs. These comparative genomics analyses, paired with MED4 and NATL1A ORFeomes, will facilitate future genotype-to-phenotype mappings and systems biology exploration of Prochlorococcus ecology.

The system identification problem with multiple nonlinearities is relevant. Its decision depends on many factors. These include: feedbacks, the method of connecting nonlinear links, signal properties. They affect the identifiability of the system parameters. We introduced a condition for the excitation constancy for state variables, which considers the S-identifiability of the system. We propose system decomposition by measuring input to identify parameters. Each subsystem has an implicit identification representation. It guarantees obtaining estimates of subsystem parameters based on experimental data. The trajectories boundedness of adaptive system proved in parametric and coordinate spaces. Conditions guaranteeing exponential stability of the system obtained. Systems of self-oscillation generation and nonlinear correction of a nonlinear system consider. Conditions for the trajectories boundedness of the adaptive system obtained for these cases. The influence of nonlinearity and feedback on the system performance estimated.

Cancers remain the lead cause of disease-related, pediatric death in North America. The emerging field of complex systems has redefined cancer networks as a computational system with intractable algorithmic complexity. Herein, a tumor and its heterogeneous phenotypes are discussed as dynamical systems having multiple, strange attractors. Machine learning, network science and algorithmic information dynamics are discussed as current tools for cancer network reconstruction. Deep Learning architectures and computational fluid models are proposed for better forecasting gene expression patterns in cancer ecosystems. Cancer cell decision-making is investigated within the framework of complex systems and complexity theory.

The Pandemic in 2019 forced a digital adaptation with direct consequences on all educational stakeholders. On behalf of teachers and trainers, while many regarded these changes with some scepticism, others embraced the opportunity to integrate technology into their teaching methods and as learning resources. As translation trainers, it is essential to follow and understand the translation market. Thus, the exponential changes that digital technology has brought to this sector over the years impose constant shifts in teaching and learning methods and resources. In fact, translators require vast competencies, amongst which is the flexibility to adapt. In translation training Project-Based Learning (PBL) has been established as an essential teaching and learning method, as it has proven to foster the development of competencies as it simulates the translator's work environment. Thus, the need to adapt new strategies reinforced PBL and its benefits. PBL, however, similar to a freelance translator, places the student in the centre of the learning process, where self-regulation becomes essential, as it is necessary to analyse the market/situation and be flexible enough to adapt to the context accordingly. As of 2018-2019, technical translation courses at ISCAP have implemented PBL as their main teaching and learning method. At the same time, a study on student self-regulation began. The purpose was to understand student perception on their own self-regulation competence and its development or lack thereof after one year of PBL. Results indicate that PBL is seen as a useful simulation of the translation labour market and that it does enhance many essential competences, amongst which is student self-regulation.

Automatic ship detection provides an essential function towards maritime domain awareness for security or economic monitoring purposes. This work presents an approach for training a deep learning ship detector in Sentinel-2 multispectral images with few labeled examples. We design a network architecture for detecting ships with a backbone that can be pre-trained separately. By using Self Supervised Learning, an emerging unsupervised training procedure, we learn good features on Sentinel-2 images, without requiring labeling, to initialize our network’s backbone. The full network is then fine-tuned to learn to detect ships in challenging settings. We evaluated this approach versus pre-training on ImageNet and versus a classical image processing pipeline. We examined the impact of variations in the self-supervised learning step and we show that in the few-shot learning setting self-supervised pre-training achieves better results than ImageNet pre-training. When enough training data is available, our self-supervised approach is as good as ImageNet pre-training. We conclude that a better design of the self-supervised task and bigger non-annotated dataset sizes can lead to surpassing ImageNet pre-training performance without any annotation costs.

Machine learning has become an increasingly ubiquitous technology, as big data continues to inform and influence everyday life and decision-making. Currently in healthcare, as well as in most other industries, the two most prevalent machine learning paradigms are supervised learning and transfer learning. Both practices rely on large-scale, manually annotated datasets to train increasingly complex models. However, the requirement of data to be manually labeled leaves an excess of unused, unlabeled data available in both public and private data repositories. Self-supervised learning (SSL) is a growing area of machine learning that has the ability to take advantage of unlabeled data. Contrary to other machine learning paradigms, SSL algorithms create artificial supervisory signals from unlabeled data and pretrain algorithms on these signals. The aim of this review is two-fold: firstly, we provide a formal definition of SSL, divide SSL algorithms into their four unique subsets, and review the state-of-the-art published in each of those subsets between the years of 2014-2020. Second, this work surveys recent SSL algorithms published in healthcare, in order to provide medical experts with a clearer picture of how they can integrate SSL into their research, with the objective of leveraging unlabeled data.

In the study, it was aimed to develop a valid and reliable scale in order to determine the self-efficacy perceptions of classroom teachers in the field of mathematics learning difficulties. In the development process of the scale, the basic resources and the scale development studies in the literature were examined. First, a pool of substances was created. Content validity was ensured by taking the opinions of 21 expert participants in the 24 question areas determined in the item pool. Content validity index was used in content validity. In this analysis, two questions were removed from the scale. Preliminary application was made with 44 participating teachers who are experts in their fields and exploratory factor analysis was started. For exploratory factor analysis, 359 people consisting of classroom teachers in Sakarya province were studied. In the explanatory factor analysis, 5 items were removed from the scale by looking at the factor load. The factor loadings for the 17 items in the scale vary between 0.508 and 0.976. Among the comparative fit indices obtained as a result of confirmatory factor analysis, RMSEA=0.067 and Cmin/DF=1.568 were calculated. The Cronbach alpha reliability coefficient of the measurements is 0.970. The data obtained were analyzed with statistical methods using SPSS 25, AMOS 24 and Microsoft Excel programs. The validity and reliability criteria of the scale developed within the scope of the study were met.

Self-supervised learning is a method that learns general representation from unlabeled data. Masked image modeling (MIM), one of the generative self-supervised learning methods, has drawn attention showing state-of-the-art performance on various downstream tasks, though showing poor linear separability resulting from the token-level approach. In this paper, we propose a contrastive learning-based multi-view masked autoencoder for MIM, exploiting an image-level approach by learning common features from two different augmented views. We strengthen MIM by learning long-range global patterns from contrastive loss. Our framework adopts simple encoder-decoder architecture, learning rich and general representation by following a simple process: 1) two different views are generated from an input image with random masking and by contrastive loss, we can learn semantic distance of the representations generated by an encoder. By applying a high mask ratio, 80%, it works as strong augmentation and alleviates the representation collapse problem. 2) With reconstruction loss, decoder learns to reconstruct an original image from the masked image. We assess our framework by several experiments on benchmark datasets of image classification, object detection, and semantic segmentation. We achieve 84.3% fine-tuning accuracy on ImageNet-1K classification and 76.7% in linear probing, exceeding previous studies and show promising results on other downstream tasks. Experimental results demonstrate that our work can learn rich and general image representation by applying contrastive loss to masked image modeling.

Intelligent Tutoring Systems (ITS) are increasingly popular for online learning. These systems use adaptive algorithms to recommend relevant content based on students' profiles. However, instructors need to periodically assess students' performance to ensure learning outcomes and adjust strategies accordingly. Our objective is to predict students' progress in advance, enabling teachers to make quicker decisions and facilitating the iterative process of adaptive algorithms. For this study, we collected a dataset from ALIN, an online learning platform, consisting of over 5,000 students' learning records and test results. Using this dataset, we conducted experiments employing various machine learning algorithms. The results indicate that learning behavior contributes to improving forecast performance, while students' progress strongly correlates with their previous test results. Additionally, we discovered that students' progress can be indirectly predicted by forecasting their scores. Furthermore, by breaking down overall scores into several distinct components and predicting individual scores for each component, the accuracy of the forecasts can be improved.

The runtime environment is an important concern for self-adaptive systems (SASs). Although researchers have proposed many approaches for developing SASs that address the issue of uncertain runtime environments, the understanding of these environments varies depending on the objectives, perspectives, and assumptions of the research. Thus, the current understanding of the environment in SAS development is ambiguous and abstract. To make this understanding more concrete, we describe the landscape in this area through a systematic literature review (SLR). We examined 128 primary studies and 14 unique environment models. We investigated concepts of the environment depicted in the primary studies and the proposed environment models based on their ability to aid in understanding. This illustrates the characteristics of the SAS environment, the associated emerging environmental uncertainties, and what is expressed in the existing environment models. This paper makes explicit the implicit understanding about the environment made by the SAS research community and organizes and visualizes them.

The genetic systems of Paspalum species have not been extensively studied. We analysed the ploidy, reproductive mode, mating system, and fertility of four Paspalum species - P. durifolium, P. ionan-thum, P. regnellii, and P. urvillei. An analysis of 378 individuals from 20 populations of north-eastern Argentina was conducted. All populations of the four Paspalum species were pure tetraploid and had a sexual and stable reproductive mode. However, some populations of P. durifolium and P. ionanthum showed low levels of apospory. Populations of P. durifolium and P. ionanthum had low seed sets under self-pollination but were fertile under open pollination, showing that self-incompatibility likely caused self-sterility. In contrast, populations of P. regnellii or P. urvillei showed no evidence of apospory and seed set in both self- and open pollination conditions were high, suggesting that they are self-compatible, due to the absence of pollen-pistil molecular in-compatibility mechanisms. The evolutionary origin of the four Paspalum species could explain these differences. This study supplies valuable insights into the genetic systems of Paspalum species, which could have implications for their conservation and management.

The contemporary landscape of education is witnessing a paradigm shift towards innovative instructional methods, with the flipped learning approach gaining considerable attention. The purpose of this research was to investigate the impact of the flipped learning approach on students' perception and acceptance throughout an entire semester in the 'Introduction to Programming with Java' course, using a research design with a quantitative approach, ultimately aiming to inform educational practice and advance our knowledge of innovative teaching methods in higher education. This study was conducted at a university with 174 students involved, divided into two groups, 87 students in the experimental group and 87 students in the control group. The data collected through the scales were analyzed by using descriptive and inferential statistical analysis techniques in statistical software. At the end of the measurements, the technology acceptance level and self-directed learning perceptions of engineering students who received education with flipped learning were high. The results suggest that educators should consider students' readiness for self-directed learning when implementing the flipped learning approach and focus on creating an environment that supports their autonomy and engagement. This research offers valuable guidance for instructors, curriculum designers, and educational policymakers seeking to enhance the effectiveness of flipped learning in higher education courses.

This paper proposes a Grouped Contrastive Learning of self-supervised Sentence Representation (GCLSR), which can learn an effective and meaningful representation of sentences. Previous works maximize the similarity between two vectors to be the objective of contrastive learning, suffering from the high-dimensionality of the vectors. In addition, most previous works have adopted discrete data augmentation to obtain positive samples and directly employed contrastive framework of computer vision to perform contrastive training, which could hamper contrastive training because text data is discrete and sparse compared with image data. To address those issues, we propose a grouped contrastive learning framework, i.e., GCLSR, which divides the high-dimensional feature vector into several groups and respectively computes the groups’ contrastive losses to make use of more local information, eventually obtaining a more fine-grained sentence representation. In addition, in GCLSR, we design a new self-attention mechanism and a continuous as well as partial word vector augmentation (PWVA). For the discrete and sparse text data, the usage of self-attention could help model focus the informative words by measuring the importance of every word in a sentence. By using the PWVA, GCLSR can obtain high-quality positive samples used for contrastive learning. Experimental results demonstrate that our proposed GCLSR achieves an encouraging result on the challenging datasets of the standard semantic textual similarity (STS) task and transfer task.

The synthesis these past few years of novel organic molecules that spontaneously self-assemble into a large variety of molecular architecture, particularly generating organogels, has opened up new horizons for preparing functional materials. Here, we present an original preparation path of such materials through the making of hybrid gels of these molecules together with covalent polymers. Three types of systems are described: i) intermingled gels where a polymer gel and an organogel pervade one another; ii) encapsulation of self-assembled filaments in polymer fibrils, which provides a system with unusual magnetic properties; iii) the reverse situation where self-assembled nanotubes sheathe polymer fibrils. Here two covalent polymers are considered: a neutral polymer, namely stereoregular polystyrene (isotactic or syndiotactic), and a semi-conducting polymer, P3BT. In the latter case, semi-conducting nanowires are obtained.

The problem addressed in this article consists of the motion control of a quadrotor, comprising model disturbances and uncertainties. In order to tackle model uncertainty, adaptive control based on reinforcement learning is used. The distinctive feature of this article, in comparison with other works on quadrotor control using reinforcement learning is the exploration of the underlying optimal control problem in which a quadratic cost and a linear dynamics allow an algorithm that runs in real time. Instead of identifying a plant model, adaptation is obtained by approximating the performance index given by the Q-function using directional forgetting recursive least squares that rely on a linear regressor build from quadratic functions of input/output data. The adaptive algorithm proposed is tested in simulation in a cascade control structure that drives a quadrotor. Simulations show the improvement in performance that results when the proposed algorithm is turned on.

In this unprecedented era of computer-supported and distance learning, it is critical to rethink the way students are supported through vital skills like self-regulation and peer collaboration. A variety of digital media has emerged, allowing learners autonomy while requiring the ability to effectively regulate different components of the educational process for long-term academic success. We reviewed collaboration, communication, and self-regulation in digital learning environments as part of online learning. We discussed how these abilities are reflected in highly cited content. High-impact factor studies were identified using advanced software Herzing Publish or Perish to retrieve highly cited research publications metrics. The search resulted in 272 records from 2010 to 2022, 192 duplicates were identified to remove and 48 JCR articles were shortlisted for review. We examined and reflected on sufficient connections to make firm judgments about correlations of concepts. The review identified prominent themes surfaced in the high impact factor academic publication e.g., digital learning environment, interaction, engagement, feedback, self-efficacy, motivation, meta-cognition, achievement, technology, blended learning, and orientation of ICT. Many studies support different features of SRL & PCL through different tools, access to educators or feedback, encouragement, and through peers. However, all of them discuss the processes that students use to self-regulate learning in these situations. It is suggested to examine whether the effectiveness of certain SRL processes varies by online learning mode.

Transition from primary to secondary school is more successful when students’ learning is consistent. Students are also more likely to enjoy the school, engage with learning, and have a high academic achievement in the secondary school when they feel motivated. This is a critical aspect especially in cases when global pandemics situations allow only the online schooling opportunity. Students that are away from school lack the traditional sources of motivation and self-regulated learning skills, thus research is needed to identify other important factors that can be developed in remote settings. The aim of this study was to find out how students perceive their experience with the transition from primary to secondary school and how such a transition influences students’ self-regulated learning (SRL) and motivation. Self-reported data were collected during the COVID-19 breakout from a total of N=80, 6th and 7th grade students aged 12-14 years old. Results showed that students had a successful transition, especially when they are supported by their parents and teachers. Next, Bivariate Pearson Correlation analysis indicated that students’ perceptions about their experience with the transition from primary to secondary school and their self-regulated learning and motivation are significantly correlated. No gender differences were found among all main study variables.

In the last decade, the genetic engineering world has been shaken up by a relatively new genetic editing tool based on RNA-guided Nucleases (RGNs): the CRISPR/Cas9 system. Since the first report in 1987 and its characterization in 2007 as a bacterial defense mechanism, the interest and research on this system have grown exponentially. CRISPR systems provide immunity to bacteria against invading genetic material; however, with specific modifications in sequence and structure, it becomes a precise editing system that makes it possible to genetically modify almost any organism. There are diverse approaches regarding the refinement of these modifications, such as constructing more accurate nucleases, understanding the cellular context and facing the epigenetic conditions, or re-designing guide RNAs (gRNAs). Considering the critical importance for the correct CRISPR/Cas9 systems performance, our scope will emphasize in the latter approach. Hence, we present an overview of the past and the most recent guide RNA web-based design tools, highlighting their computational architecture and gRNA characteristics evolution through the years. Our study concisely explains the computational approaches that use machine learning techniques, deep neural networks, and large datasets of gRNA/target interactions to make possible both predictions and classifications directed to design, optimize, and create promising gRNAs suitable for future gene therapies.

This article has been developed to assess the economic feasibility of a roof-top photovoltaic installation of industrial self-consumption. Numerical models that enable an interested person to obtain the main expected parameters will be generated. To do this, a calculation methodology will be generated through which the reader, knowing the location of the facility and dimensions of the roof, will be able to calculate the maximum installable power, the main parameters related to production, the cost of the installation, and the LCOE of the plant. The use of actual costs will be facilitated in case they are known, but it will remain possible to apply the costs of the major equipment (modules, inverter, and structure) considered throughout the article. This developed calculation methodology will also allow a quick comparison of the forecasts of production, CAPEX, and LCOE of plants designed with different inclinations and different types of modules. Consequently, it will be especially useful for decision-making before developing the plant's basic engineering. Moreover, the calculations used for modeling the LCOE will be analyzed in depth. This analysis will allow evaluating how the different technical variables affect the profitability of a photovoltaic installation, such as the selected tilt, the location, the module's technology, or the available area.

In software development, developers received bug reports that describe the software bug. Developers find the cause of bug through reviewing the code and reproducing the abnormal behavior that can be considered as tedious and time-consuming processes. The developers need an automated system that incorporates large domain knowledge and recommends a solution for those bugs to ease on developers rather than spending more manual efforts to fixing the bugs or waiting on Q&A websites for other users to reply to them. Stack Overflow is a popular question-answer site that is focusing on programming issues, thus we can benefit knowledge available in this rich platform. This paper, presents a survey covering the methods in the field of mining software repositories. We propose an architecture to build a recommender System using the learning to rank approach. Deep learning is used to construct a model that solve the problem of learning to rank using stack overflow data. Text mining techniques were invested to extract, evaluate and recommend the answers that have the best relevance with the solution of this bug report.

Importance and need for cyber security have increased in folds since a decade. Indirectly, the country’s security depends on the country’s cyber-physical systems. Attackers are becoming more innovative, and attacks are becoming undetectable, causing huge risks to the systems. In this scenario, intelligent and evolving detection methods should be introduced to replace the basic and outworn ones. This article discusses about new-age intelligence and smart techniques dealing with artificial intelligence (AI) models. Artificial intelligence for cyber security is reviewed, and the performance of machine learning models (ML) and deep learning (DL) models are analysed. A real-time case study of stealthy local covert attacks with false data injection attacks is implemented on the DC-DC converter. A deep learning model is designed to mitigate cyber attacks, and its performance is evaluated.

In this brief letter we report our initial results on the application of deep-learning to the massive MIMO channel estimation challenge. We show that it is possible to estimate wireless channels and that the possibility of mitigating pilot-contamination with deep-learning is possible given that the leaning model underwent an extensive training-phase and that it has been presented with a large number of different channel conditions.

In the recent years, with the advent of Artificial Intelligence (AI) traditional methods have seen a significant transformation in the agriculture sector, especially in soil management. Soil management involves practices that maintains and improves the physical, chemical as well as the biological properties of the soil. Soil health management is essential for both the environmental conservation and sustainable agriculture production, ensuring the soil productivity and functional aspects associated with the ecosystem. Soil health management is one of the most important aspects of agriculture and food production, hence preserving and enhancing the soil health is an essential factor for supporting agriculture. Integration of Artificial Intelligence (AI) technologies with soil health management offers the potential to enhance agricultural sustainability, productivity, adapt to the climatic changes and resource constraints. The study of AI tools that can help improve soil health management by providing more accurate and efficient monitoring, analysis and decision-making capabilities. This paper studies the potential AI technologies including machine learning, robotics, and remote sensing in enhancing soil health, raising crop yields, and lowering environmental concerns by examining previous research and case studies.

Recommendation systems are crucial in navigating the vast digital market. However, user data’s dynamic and non-stationary nature often hinders their efficacy. Traditional models struggle to adapt to the evolving preferences and behaviours inherent in user interaction data, posing a significant challenge for accurate prediction and personalisation. Addressing this, we propose a novel theoretical framework, the Non-stationary Transformer, designed to capture and leverage the temporal dynamics within data effectively. This approach enhances the traditional transformer architecture by introducing mechanisms accounting for non-stationary elements, offering a robust and adaptable solution for recommendation systems. Our experimental analysis, encompassing deep learning and reinforcement learning paradigms, demonstrates the framework’s superiority over benchmark models. The empirical results confirm the efficacy of our proposed framework, which not only provides significant performance enhancements, approximately 8% in Logloss reduction and up to 2% increase in F1 score but also underscores its potential applicability across accumulative reward scenarios. These findings advocate adopting Non-stationary Transformer models to tackle the complexities of today’s recommendation tasks.

Deep convolutional neural networks (CNNs) have revolutionised computer vision technology by automatically learning hierarchical representations of image data, leading to state-of-the-art performance in visual recognition tasks. This article presents a comprehensive review of deep CNNs, from their evolution and architectures to the current state-of-the-art research. The review also provides the core concepts and building blocks of CNNs and their concise mathematical representations. Furthermore, it explores applications of deep CNNs in three popular domains, including medical diagnosis, remote sensing, and facial recognition. This review will benefit researchers and practitioners in computer vision and artificial intelligence, as well as industry professionals seeking to leverage the latest advancements in deep learning technologies.

We explore 3D printing modules for self-assembling spacecraft and robots – structure, actuators, electrics. Self-assembly has long been viewed as a highly desirable capability for autonomous construction of large space structures. We review self-assembly in space which focusses on the self-assembly of modules that demonstrate the range of applications. However, self-assembly may be synergised with 3D printing to offer an automated capability from raw material to modules for assembling new spacecraft or habitats. One application of 3D printing is using space debris on-orbit as an in-situ resource - defunct spacecraft may be salvaged as raw material for in-situ construction on demand. The common features of all self-assembling modules are that the modules constitute a structure housing a computer-controlled actuator internally and a reversible latching mechanism externally. We have demonstrated a 3D printed DC electric motor in which the only components that were not 3D printed are the wire coils. We have married our 3D printed motor prototype as an actuated joint between two 3D printed trigon-type panels developed as part of a trigon self-assembling system concept. The trigon concept underlies a modular approach to self-assembling and self-deploying structures. The 3D printed motorised panel system demonstrates that the motor aspect and structural aspects of robotic self-assembling machines are amenable to 3D printing. This has implications for self-assembling systems into modular satellites as a solution to space debris.

Ever since Varela and Maturana proposed the concept of autopoiesis as the minimal requirement for life, there has been a focus on cellular systems that erect topological boundaries to separate themselves from their surrounding environment. Here we reconsider whether the existence of such a spatial boundary is strictly necessary for self-producing entities. This work presents a novel computational model of a minimal autopoietic system inspired by dendrites and molecular dynamics simulations in three-dimensional space. A series of simulation experiments where the metabolic pathways of a particular autocatalytic set are successively inhibited until autocatalytic entities that could be considered autopoietic are produced. These entities maintain their distinctness in an environment containing multiple identical instances of the entities without the existence of a topological boundary. This gives rise to the concept of a metabolic boundary which manifests as emergent self-selection criteria for the processes of self-production without any need for unique identifiers. However, the adoption of such a boundary comes at a cost, as these autopoietic entities are less suited to their simulated environment than their autocatalytic counterparts. Finally, this work showcases a generalized metabolism-centered approach to the study of autopoiesis that can be applied to both physical and abstract systems alike.

Text annotation is an essential element of the natural language processing approaches. The manual annotation process performed by humans has several drawbacks, such as subjectivity, slowness, fatigue, and possibly carelessness. In addition, annotators may annotate ambiguous data. So, we developed the concept of automated annotation to get the best annotations using several machine-learning approaches. The proposed approach is based on an ensemble algorithm of meta-learners and meta-vectorizer techniques. The approach employs a semi-supervised learning technique for automated annotation, aimed at detecting hate speech. This involves leveraging various machine learning algorithms, including Support Vector Machine (SVM), Decision Tree (DT), K-Nearest Neighbors (KNN), and Naive Bayes (NB), in conjunction with Word2Vec and TF-IDF text extraction methods. The annotation process is performed using 13,169 Indonesian YouTube comments data. The proposed model used a Stemming approach using data from Sastrawi and also new data of 2,245 words. Semi-supervised learning uses 5%, 10%, and 20% of labeled data as compared to performing labeling based on 80% of the datasets. In semi-supervised learning, the model learns from the labeled data, which provides explicit information, and the unlabeled data, which offers implicit insights. This hybrid approach enables the model to generalize and make informed predictions even when limited labeled data is available, ultimately enhancing its ability to handle real-world scenarios with scarce annotated information. In addition, the proposed method uses a variety of thresholds for matching words labeled with hate speech ranging from 0.6, 0.7, 0.8, and 0.9. The experiment showed that the KNN-Word2ec model has the best accuracy value of 96.9% with a scenario of 5%:80%:0.9. However, several other methods have also accuracy above 90%, such as SVM and DT based on both text extraction methods in several test scenarios.

Goal-conditioned reinforcement learning (RL) holds promise for addressing intricate control challenges by enabling agents to learn and execute desired skills through separate decision modules. However, the irregular occurrence of required skills poses a significant challenge to effective learning. In this paper, we demonstrate the detrimental effects of this imbalanced skill(sub-goal) distribution and propose a novel training approach, Classified Experience Replay (CER), designed to mitigate this challenge. We demonstrate that adapting our method to conventional RL methods significantly enhances the performance of the RL agent. Considering the challenges inherent in tasks such as driving, characterized by biased occurrences of required sub-goals, our study demonstrates the improvement in trained outcomes facilitated by the proposed method. In addition, we introduce a specialized framework tailored for self-driving tasks on highways, integrating Model Predictive Control (MPC) into our RL trajectory optimization training paradigm. Our approach, utilizing CER with the suggested framework, yields remarkable advancements in trajectory optimization for RL agents operating in highway environments.

In this paper major machine learning (ML) tools and the most important applications developed elsewhere for numerical weather and climate modeling systems (NWCMS) are reviewed. NWCMSs are briefly introduced. The most important papers published in this field in recent years are reviewed. The advantages and limitations of the ML approach in applications to NWCMS are briefly discussed. Currently, this field is experiencing explosive growth. Several important papers are published every week. Thus, this paper should be considered a simple introduction to the problem.

This study aims to evaluate the utilization and effectiveness of artificial intelligence (AI) applications in managing symptoms of anxiety and depression. The primary objectives are to identify current AI tools, analyze their practicality and efficacy, and assess their potential benefits and risks. A comprehensive literature review was conducted using databases such as ScienceDirect, Google Scholar, PubMed, and ResearchGate, focusing on publications from the last five years. The search utilized keywords including "artificial intelligence," "applications," "mental health," "anxiety," "LLMs" and "depression". Various AI tools, including chatbots, mobile applications, wearables, virtual reality settings, and large language models (LLMs), were examined and categorized based on their functions in mental health care. The findings indicate that AI applications, including LLMs, show significant promise in symptom management, offering accessible and personalized interventions that can complement traditional mental health treatments. Tools such as AI-driven chatbots, mobile apps, and LLMs have demonstrated efficacy in reducing symptoms of anxiety and depression, improving user engagement and mental health outcomes. LLMs, in particular, have shown potential in enhancing therapeutic chatbots, diagnostic tools, and personalized treatment plans by providing immediate support and resources, thus reducing the workload on mental health professionals. However, limitations include concerns over data privacy, the potential for over-reliance on technology, and the need for human oversight to ensure comprehensive care. Ethical considerations, such as data security and the balance between AI and human interaction, were also addressed. The study concludes that while AI, including LLMs, has the potential to significantly aid mental health care, it should be used as a complement to, rather than a replacement for, human therapists. Future research should focus on enhancing data security measures, integrating AI tools with traditional therapeutic methods, and exploring the long-term effects of AI interventions on mental health. Further investigation is also needed to evaluate the effectiveness of AI applications across diverse populations and settings.

Computers have evolved over the years and as the evolution continues, we have been ushered into an era where high-speed internet has made it possible for devices in our homes, hospital, energy and industry to communicate with each other. This era is what is known as the Internet of Things (IoT). IoT has several benefits in the health, energy, transportation and agriculture sectors of a country’s economy. These enormous benefits coupled with the computational constraint of IoT devices which makes it difficult to deploy enhanced security protocols on them make IoT devices a target of cyber-attacks. One approach that has been used in traditional computing over the years to fight cyber-attacks is Intrusion Detection System (IDS). However, it is practically impossible to deploy IDS meant for traditional computers in IoT environments because of the computational constraint of these devices. In this regard, this study proposes a lightweight IDS for IoT devices using an incremental ensemble learning technique. We used Gaussian Naive Bayes and Hoeffding tree to build our incremental ensemble model. The model was then evaluated on the TON IoT dataset. Our proposed model was compared with other state-of-the-art methods proposed and evaluated using the same dataset. The experimental results show that the proposed model achieved an average accuracy of 99.98\%. We also evaluated the memory consumption of our model which showed that our model achieved a lightweight model status of 650.11KB as the highest memory consumption and 122.38KB as the lowest memory consumption.

The relevance of bacteria to subjective experiences or qualia is under-appreciated. Here, I make four proposals. Firstly, living systems traverse sequences of active states that determine their behaviour; these states result from competitive coherence, which depends on a connectivity-based competition between a Next process and a Now process whereby elements in the active state at time n+1 are chosen between the elements in the active state at time n and those elements in the developing n+1 state. Secondly, bacteria should help us link the mental to the physical world given that bacteria were here first, are highly complex, influence animal behaviour and dominate the Earth. Thirdly, the operation of competitive coherence to generate active states in bacteria, brains and other living systems is inseparable from qualia. Fourthly, these qualia become particularly important to the generation of active states in the highest levels of living systems, namely, the ecosystem and planetary levels.

The practice of quantified-self sleep tracking is increasingly common nowadays among healthy individuals as well as patients with sleep problems. However, existing sleep-tracking technologies only support simple data collection and visualization, and are incapable of providing actionable recommendations that are tailored to users' physical, behavioral and environmental context. Here we coined the term context-aware sleep health recommender system (CASHRS) as an emerging multidisciplinary research field that bridges ubiquitous sleep computing and context-aware recommender systems. In this paper, we presented a narrative review to analyze the type of contextual information, the recommendation algorithms, the context filtering techniques, the behavior change techniques, the system evaluation, and the challenges in peer-reviewed publications that meet the characteristics of CASHRS. Analysis results identified current research trends, the knowledge gap, and future research opportunities in CASHRS.

Since the emergence of the quantified self movement, users aim at health behavior change, but only those who are sufficiently motivated and competent with the tools will succeed. Our literature review shows that theoretical models for quantified self exist but they are too abstract to guide the design of effective user support systems. Here, we propose principles linking theory and implementation to arrive at a hierarchical model for an adaptable and personalized self-quantification system for physical activity support. We show that such a modeling approach should include a multi-factors user model (activity, context, personality, motivation), a hierarchy of multiple time scales (week, day, hour), and a multi-criteria decision analysis (user activity preference, user measured activity, external parameters). This theoretical groundwork, which should facilitate the design of more effective solutions, has now to be validated by further empirical research.

Importance and need for cyber security have increased in folds since a decade. Indirectly, the country’s security depends on the country’s cyber-physical systems. Attackers are becoming more innovative, and attacks are becoming undetectable, causing huge risks to the systems. In this scenario, intelligent and evolving detection methods should be introduced to replace the basic and outworn ones. This article discusses about new-age intelligence and smart techniques dealing with artificial intelligence (AI) models. Artificial intelligence for cyber security is reviewed, and the performance of machine learning models (ML) and deep learning (DL) models are analysed.

In the realm of mathematics education, self-explanation stands as a crucial learning mechanism, allowing learners to articulate their comprehension of intricate mathematical concepts and strategies. As digital learning platforms grow in prominence, there are mounting opportunities to collect and utilize mathematical self-explanations. However, these opportunities are met with challenges in automated evaluation. Automatic scoring of mathematical self-explanations is crucial for preprocessing tasks, including the categorization of learner responses, identification of common misconceptions, and the creation of tailored feedback and model solutions. Nevertheless, this task is hindered by the dearth of ample sample sets. Our research introduces a semi-supervised technique using the Language Learning Model (LLM), specifically its Japanese variant, to enrich datasets for the automated scoring of mathematical self-explanations. We rigorously evaluated the quality of self-explanations across five datasets, ranging from human-evaluated originals to ones devoid of original content. Our results show that combining LLM-based explanations with mathematical material significantly improves the model's accuracy. Interestingly, there's an optimal limit to how much synthetic self-explanation data can bene-fit the system. Exceeding this limit doesn't further improve outcomes. This study thus highlights the need for careful consideration when integrating synthetic data into solutions, especially within the mathematics discipline.

This work provides an update to the Erasmus Plus TEALEAF project The outcomes of a week-long EU-funded / Irish Government-recognized teacher course in July 2016 is described within the context of a qualitative small scale study investigating teachers' progress in the course. The explicit aim of the teacher course was to equip a diverse group of teachers with the initial tools to work to produce simple digital apps for learning about biodiversity in their respective domains. A community of practice seeks to establish a new concept of the pre-existing generalised collective conscience through triangulated conversation between the generalised and particularised collective and individual consciences. In particular to revise the generalised collective conscience that teachers can program apps for learning about biodiversity. A number of features of teaching and learning were selected in general and their relationship to constructivism delineated. The teachers were prompted for their responses to each day of the course through a self evaluation tool and the responses were ranked according the the rubric. The data was analyzed using multidimensional scaling - ASCAL procedure - in SPSS 23TM and within the repertory grid domain according to the RepSocio tool in Rep 5TM. The plots show a gradual development throughout the week in terms of specific features becoming 'stronger' or exerting more influence towards the middle of the course and fragmenting after that. Analyses were able to show which participants correlated most closely with the hypothetical IDEAL within the community of practice. Concerning this community of practice, one determine the interrelationships within the community are determined using a social mapping exercise moving from the individual consciences to a particularised collective conscience.

The aim of the present study was to predict the response of non-small cell lung cancer (NSCLC) patients to immune checkpoint inhibitors (ICIs) by leveraging computed tomography (CT) images using deep learning techniques. Retrospectively, 624 sequential CT images were gathered from 156 patients at Jiangsu Province Hospital, along with their clinical data. The dataset was subsequently partitioned into three groups: training (n=547), validation (n=64), and test (n=64). Moreover, an external validation cohort included 37 CT images from patients at Nanjing Pukou Peoples' Hospital, accompanied by comprehensive clinical data. An advanced Video Vision Transformer (ViViT) model incorporating global self-attention was utilized to analyse patients treated with ICIs and predict their response. The ViViT model's efficacy was evaluated using a confusion matrix and a receiver operating characteristic curve (ROC). Notably, the ViViT model demonstrated predictive prowess for ICIs response, yielding respective areas under the receiver operating characteristic curve (AUC) of 0.74 (95% CI: 0.69-0.78), 0.74 (95% CI: 0.61-0.86), 0.76 (95% CI: 0.62-0.88), and 0.69 (95% CI: 0.5-0.87) in the training, validation, test, and external validation cohorts. The present study illustrates how a deep learning model can provide a non-invasive means to predict clinical outcomes in NSCLC patients undergoing ICIs, potentially transforming personalized treatment approaches for individuals with NSCLC.

If a subject learns about the properties of an alternative under a high state of food deprivation, it will prefer this alternative over a similar one in a later choice test, although the subject is currently under a relative state of satiety. In this experiment, we probe this effect in a delay-discounting task, where the reward of the experienced alternative is progressively delayed. Eight male Wistar rats were trained to respond to an alternative under a high state of deprivation and eight rats under a relative state of satiety. After 20 sessions, their weight was recalibrated to a state of relative satiety. Then, they were exposed to a delay-discounting task where the long-larger alternative was the one used during training. The group that experienced the alternative under a higher level of food deprivation preferred more this alternative, and its preference stayed across time. On the contrary, the group that experienced the alternative under a lower level of food deprivation systematically preferred the small-shorter alternative. Our results support that the reinforcement value may be sensitive to the organism's state at the moment an alternative is experienced for the first time.

Recently deep cross-modal hashing networks have received increasing interests due to its superior query efficiency and low storage cost. However, most of existing methods concentrate less on hash representations learning part, which means the semantic information of data cannot be fully used. Furthermore, they may neglect the high-ranking relevance and consistency of hash codes. To solve these problems, we propose a Self-Attention and Adversary Guided Hashing Network (SAAGHN). Specifically, it employs self-attention mechanism in hash representations learning part to extract rich semantic relevance information. Meanwhile, in order to keep invariability of hash codes, adversarial learning is adopted in the hash codes learning part. In addition, to generate higher-ranking hash codes and avoid local minima early, a new batch semi-hard cosine triplet loss and a cosine quantization loss are proposed. Extensive experiments on two benchmark datasets have shown that SAAGHN outperforms other baselines and achieves the state-of-the-art performance.

The increasingly used approach of combining different simulation software in testing of automated driving systems (ADS) increases the need for potential and convenient software designs. Recently developed co-simulation platforms (CSP) provide the possibility to cover the high demand on testing kilometers for ADS by combining vehicle simulation software (VSS) with traffic flow simulation software (TFSS) environments. The emphasis on the demand of testing kilometers is not enough to choose a suitable CSP. The complexity level of the used vehicle, object, sensors and environment models is essential for valid and representative simulation results. Choosing a suitable CSP raises the question of how the test procedures should be defined and constructed and what the relevant test scenarios are. Parameters of the ADS, the environments, objects, sensors in VSS as well as traffic parameters in TFSS can be used to define and generate test scenarios. In order to generate a large number of scenarios in a systematic and automated way, suitable and appropriate software designs are required. In this paper we present a software design for CSP based on the Model-View-Controller (MVC) design pattern and implementation of a complex CSP for virtual testing of ADS. Based on this design, an implementation of a CSP is presented using the VSS from IPG Automotive called CarMaker and the TFSS from PTV Group called Vissim. The results have shown that the presented CSP design and the implementation of the co-simulation can be used to generate relevant scenarios for testing of ADS.

This paper presents an innovative multi-agent, data-driven reinforcement learning (RL) approach to develop and utilize the thermal equivalent network model that represents the motor's thermal dynamics. A multi-agent reinforcement learning is designed and trained to adjust the model parameters using data from several motor driving cycles. To ensure the incoming driving cycle matches the historical data before employing the pre-trained RL agents, offline statistical analysis and clustering techniques are developed and used. Numerical simulations highlighted the RL agent's ability to develop strategies that effectively address the variability of driving cycles. The proposed RL framework showed its capability to accurately reflect the motor's thermal behavior under various driving conditions.

In the rapidly evolving landscape of cybersecurity, Intrusion Detection Systems (IDS) play a critical role in safeguarding networks and systems from unauthorized access and malicious activities. Traditional IDS approaches, relying heavily on predefined rules and signature-based detection, often struggle to keep pace with the dynamic nature of modern cyber threats. Deep learning, with its ability to automatically learn complex patterns and representations from large datasets, offers a promising solution to this challenge. This paper explores the application of deep learning techniques in enhancing the effectiveness and accuracy of IDS. By leveraging advanced neural network architectures such as convolutional neural networks (CNNs), recurrent neural networks (RNNs), and autoencoders, deep learning-based IDS can detect both known and unknown (zero-day) attacks with higher precision. We discuss the advantages of deep learning in IDS, including its capability to handle large-scale data, adaptability to evolving threats, and reduced dependency on human intervention. Furthermore, this paper reviews recent advancements in deep learning for IDS, highlights the challenges associated with their implementation, and suggests future directions for research to overcome these hurdles. The integration of deep learning into IDS frameworks represents a significant step forward in the development of intelligent and autonomous cybersecurity systems.

Decision sciences (DSC) involve studying complex dynamic systems and processes to aid informed choices subject to constraints in uncertain conditions. It integrates multidisciplinary methods, techniques, and strategies to evaluate decision engineering processes, identifying alternatives and providing insights towards enhancing prudent decision-making. This study analyzes the evolutionary trends and innovation in DSC education and research to uncover the transformations over the years. We employ the science mapping method, text analytics, and metadata from bibliographic databases to evaluate thematic and social structures. The results highlight data science methods, including data mining and business/learning analytics as essential components. The evolutionary trends in DSC education and research mirror the development in practice, including technological transformation, computer science advances, and engineering processes. Sustainable education through virtual/online learning also constitutes a significant component of scientific production. The evolutionary trends in DSC education and research highlight innovative pedagogical approaches and strategies, including computer simulation and games ('play and learn'). The current era witnessed generative artificial intelligence (GenAI) adoption (e.g., ChatGPT) in teaching, learning, and scholarly activities amidst challenges (academic integrity, plagiarism, intellectual property violations, and other ethical and legal issues). Future research will implement and integrate AI automatic detection systems to address some GenAI adoption challenges.

The rapid advancement of technology has revolutionized language learning, introducing innovative methods that depart from traditional instructional approaches. This study employs a mixed-methods research design to examine the impact of chatbot-based language learning support, adaptive learning algorithms, and virtual reality language immersion on the language learning proficiency and self-regulated learning skills of English as a Foreign Language (EFL) learners. The research design includes quantitative analysis of language proficiency scores and qualitative exploration of learner experiences with the technological interventions. The theoretical implications of this study are rooted in constructivist and socio-cultural learning theories, which underpin the design and implementation of the technological interventions. The triangulation of qualitative and quantitative data revealed that the participants' positive perceptions of the effectiveness of chatbot-based language learning support were supported by the quantitative results, with the variable "chat-bot based support" demonstrating a substantial mean difference compared to other groups. This convergence of findings reinforces the positive influence of chatbot-based support on language learning outcomes and highlights the importance of integrating theoretical perspectives with empirical evidence to gain a comprehensive understanding of the impact of technological interventions on language learning outcomes for EFL learners. The study's findings provide insights into the potential of these technological interventions to optimize language learning outcomes for EFL learners and promote autonomous learning behaviors.

The interest on the use of renewable energy resources is increasing, especially towards wind and hydro powers, which should be efficiently converted into electric energy via suitable technology tools. To this aim, self--tuning control techniques represent viable strategies that can be employed for this purpose, due to the features of these nonlinear dynamic processes working over a wide range of operating conditions, driven by stochastic inputs, excitations and disturbances. Some of the considered methods were already verified on wind turbine systems, and important advantages may thus derive from the appropriate implementation of the same control schemes for hydroelectric plants. This represents the key point of the work, which provides some guidelines on the design and the application of these control strategies to these energy conversion systems. In fact, it seems that investigations related with both wind and hydraulic energies present a reduced number of common aspects, thus leading to little exchange and share of possible common points. This consideration is particularly valid with reference to the more established wind area when compared to hydroelectric systems. In this way, this work recalls the models of wind turbine and hydroelectric system, and investigates the application of different control solutions. The scope is to analyse common points in the control objectives and the achievable results from the application of different solutions. Another important point of this investigation regards the analysis of the exploited benchmark models, their control objectives, and the development of the control solutions. The working conditions of these energy conversion systems will be also taken into account in order to highlight the reliability and robustness characteristics of the developed control strategies, especially interesting for remote and relatively inaccessible location of many installations.

Recommender systems have been applied in a wide range of domains such as e-commerce, media, banking, and utilities. This kind of system provides personalized suggestions based on large amounts of data in order to increase user satisfaction. These suggestions help client select products, while organizations can increase the consumption of a product. In the case of social data, sentiment analysis can help gain better understanding of a user’s attitudes, opinions and emotions, which is beneficial to integrate in recommender systems for achieving higher recommendation reliability. On the one hand, this information can be used to complement explicit ratings given to products by users. On the other hand, sentiment analysis of items that can be derived from online news services, blogs, social media or even from the recommender systems themselves is seen as capable of providing better recommendations to users. In this study, we present and evaluate a recommendation approach that integrates sentiment analysis into collaborative filtering methods. The recommender system proposal is based on an adaptive architecture, which includes improved techniques for feature extraction and deep learning models based on sentiment analysis. The results of the empirical study performed with two popular datasets show that sentiment–based deep learning models and collaborative filtering methods can significantly improve the recommender system’s performance.

Environmental and economic needs drive the increased penetration of intermittent renewable energy in electricity grids, enhancing uncertainty in market conditions prediction and network constraints. Thereafter, the importance of energy systems with flexible dispatch is reinforced, ensuring energy storage as an essential asset for these systems to be able to balance production and demand. In order to do so, such systems should participate in whole-sale energy markets, enabling competition among all players, including conventional power plants. Consequently, an effective dispatch schedule considering market and resource uncertainties is crucial. In this context, an innovative dispatch optimization strategy for schedule planning of renewable systems with storage is presented. Based on an optimization algorithm combined with a machine learning approach, the proposed method develops a financial optimum schedule with the incorporation of uncertainty information. Simulations performed with a concentrated solar power plant model following the proposed optimization strategy demonstrate promising financial improvement with a dynamic and intuitive dispatch planning method, emphasizing the importance of uncertainty treatment on the enhanced quality of renewable systems scheduling.

Self-sustained learning (SSL) is considered a crucial factor in promoting students’ long-term learning and development in a sustainable society. To deepen the understanding of SSL, especially in the context of learning English as a second language, the current study examined the influence of intercultural communicative skills, language mindset, and positive L2 self on SSL in English learning among 1,238 college students in China. The results showed that students not only had a strong language mindset, positive L2 self, and intercultural communicative skills but also scored higher in long-term self-sustained English learning. Findings from the Structural Equation Modeling indicated that both language mindset and intercultural communicative skills positively predicted positive L2 self and self-sustained English learning. Furthermore, language mindset and intercultural communicative skills had an indirect impact on self-sustained English learning through positive L2 self. These findings suggest that to promote English learners’ SSL, instructors should help facilitate students’ intercultural communicative skills and foster a growth language mindset, as well as positive language learning beliefs.

"Finding fresh water in the ocean of data." is a challenge that all deep learning domains struggle with, especially in the area of hyperspectral image analysis. As hyperspectral remote sensing technology advances by leaps and bounds, there are increasing amounts of hyperspectral images(HSIs) can be available. Whereas in fact, these unlabeled HSIs are powerless to be used as material to driven a supervised learning task due to the extremely expensive labeling costs and some unknown regions. Although learning-based methods have achieved remarkable performance due to their superior ability to represent features, at the cost, these methods are complex, inflexible and tough to carry out transfer learning. In this paper, we propose the "Instructional Mask AutoEncoder"(IMAE), which is a simple and powerful self-supervised learner for HSI classification that uses a transformer-based mask autoencoder to extract the general features of HSIs through a self-reconstructing agent task. Moreover, we utilize the metric learning to perform an instructor which can direct the model focus on the human interested region of the input so that we can alleviate the defects of transformer-based model such as local attention distraction, lack of inductive bias and tremendous training data requirement. In downstream forward propagation, instead of global average pooling, we employ a learnable aggregation to put the tokens into fullplay. The obtained results illustrate that our method effectively accelerates the convergence rate and promotes the performance in downstream task.

We propose a novel transfer learning method for speech emotion recognition allowing us to obtain promising results when only few training data is available. With as low as 125 examples per emotion class, we were able to reach a higher accuracy than a strong baseline trained on 8 times more data. Our method leverages knowledge contained in pre-trained speech representations extracted from models trained on a more general self-supervised task which doesn’t require human annotations, such as the wav2vec model. We provide detailed insights on the benefits of our approach by varying the training data size, which can help labeling teams to work more efficiently. We compare performance with other popular methods on the IEMOCAP dataset, a well-benchmarked dataset among the Speech Emotion Recognition (SER) research community. Furthermore, we demonstrate that results can be greatly improved by combining acoustic and linguistic knowledge from transfer learning. We align acoustic pre-trained representations with semantic representations from the BERT model through an attention-based recurrent neural network. Performance improves significantly when combining both modalities and scales with the amount of data. When trained on the full IEMOCAP dataset, we reach a new state-of-the-art of 73.9% unweighted accuracy (UA).

Based on a measuring system to determine levels of spatial organization in 2D polygons (homogeneous or heterogeneous partition of defined areas) lying on principles of regularity, we propose the entropy term linked to the concept of “information”, from the “information theory field”, in order to obtain an information measurement regarding a quantity of or amount of information in the architecture of complex 2D biological organizations. The term “quantity” does not refer to the amount of data (size), but to the probability of a geometrical basic pattern within a set of possible statistical configurations regarding levels of homogeneity and heterogeneity. It is this notion of information that is important in information theory, and measures of information in units of bits, what we propose to use for measuring quantities of organization in the architecture of complex geometrical systems. Two complex systems are tested, biological and non biological in order to obtain experimental results, which are verified with the evaluation criteria “entropy”. Experimental results show that the lowest levels of information and entropy, in addition with low rates of heterogeneity and high rates of homogeneity are particular features of geometrical organizations in biological systems.

Falls are a major public health problem among older adults, therefore predicting the risk of having falls in the near future is of great importance for health and social systems worldwide. Nowadays, prospective fall risk assessment relies on clinical and functional mobility assessment tools, such as the Timed Up and Go (TUG) test. Recently, wearable inertial measurement unit (IMU) sensors measurements have been proposed for fall detection. We hypothesize that the IMU readings captured during TUG test realizations can provide prospective fall risk prediction. In this study, analysis by deep learning convolutional neural networks (CNN) and recurrent neural networks (RNN) were used for fall prediction based on features extracted from IMU data acquired during TUG test realizations. Data is obtained from a cohort of 106 older adults wear-ing a wireless inertial sensor with a sampling frequency of 100 Hz while performing the TUG test. Prospective fall incidence was obtained in a six-month follow-up period and used as the ground truth for the supervised training and validations of the deep learning and competing machine learning approaches. Further data collection could lead to potential fall risk biomarker. A repeated hold out cross-validation process using 75 subjects for training and 31 subjects for testing was carried out. Best results were achieved by a bidirectional long short-term memory (BLSTM), obtaining an accuracy of 0.83 and AUC of 0.73 with good sensitivity and specificity values.

As a complementary and alternative medicine in the western countries for decades, traditional Chinese medicine (TCM) has been used for more than 2000 years in China. Because of the characteristics of the philosophical style and the unknown mechanism of action, TCM sometimes has been biasedly described as "fraught with pseudoscience". From the scientific basis of the systems biology, here we promoted a novel medical model called the entropic systems medicine which could be applied to scientize TCM in future. In entropic systems medicine, TCM and Western modern biomedicine target the different variables of the entropic system. For instance, while Western modern biomedicine directly targets the phenotypes and its SOCs of macrostates, TCM differently targets the microstates, entropy and entropic force to generate SOTFs gradually causing the differentiated syndromes to be slowly rearranged. The prerequisites to modernize TCM are the entropic systems biology having been well established so that the variables could be precisely monitored and mathematically calculated.

This study evaluates the effectiveness of Darknet53 and VGG16 pretrained models to develop a hybrid ensemble model named HybridPlantNet23 deep learning model for effective plant disease classification, using the publicly available dataset ‘A Dataset of Leaf Images’ from Mendeley webpage. The preprocessing of the dataset involved resizing the images to the respective requirements of the pretrained models to develop a combined datastore which served as the input. All experiments were conducted using MATLAB R2023b deep network designer interface. Model performances were evaluated based on the conventional accuracy, precision, recall, and F1-score. VGG16 achieved the highest accuracy (97.25%), precision (96.30%), recall (96.96%), and F1-score (96.55%), outperforming both Darknet53 and the ensemble HybridPlantNet23 model. Despite the advanced architecture of the ensemble model, its performance (accuracy: 95.37%, precision: 93.56%, recall: 94.20%, F1-score: 93.74%) was not significantly superior, thus highlighting scientific reasons behind this development. Recommendations for future works were provided accordingly.

In this study, we present a novel approach to estimate the Hurst exponent of time series data using a variety of machine learning algorithms. The Hurst exponent is a crucial parameter in characterizing long-range dependence in time series, and traditional methods such as Rescaled Range (R/S) analysis and Detrended Fluctuation Analysis (DFA) have been widely used for its estimation. However, these methods have certain limitations, which we sought to address by modifying the R/S approach to distinguish between fractional Lévy and fractional Brownian motion, and by demonstrating the inadequacy of DFA and similar methods for data that resembles fractional Lévy motion. This inspired us to utilize machine learning techniques to improve the estimation process. In an unprecedented step, we train various machine learning models, including LightGBM, MLP, and AdaBoost, on synthetic data generated from random walks, namely fractional Brownian motion and fractional Lévy motion, where the ground truth Hurst exponent is known. Meaning that we can initialize and create these stochastic processes with a scaling Hurst/scaling exponent which, is then used as the ground truth for training. Furthermore, we perform the continuous estimation of the scaling exponent directly from the time series, without resorting to the calculation of the power spectrum or other sophisticated preprocessing steps, as done in past approaches. Our experiments reveal that the machine learning-based estimators outperform traditional R/S analysis and DFA methods in estimating the Hurst exponent, particularly for data akin to fractional Lévy motion. Validating our approach on real-world financial data, we observe a divergence between the estimated Hurst/scaling exponents and results reported in the literature. Nevertheless, the confirmation provided by known ground truths reinforces the superiority of our approach in terms of accuracy. This work highlights the potential of machine learning algorithms for accurately estimating the Hurst exponent, paving new paths for time series analysis. By marrying traditional finance methods with the capabilities of machine learning, our study provides a novel contribution towards the future of time series data analysis.

The research of object classification and part segmentation is a hot topic in computer vision. A considerable number of studies have been carried out about deep learning on 3D point clouds. However,it is challenging to achieve effective feature learning due to sparsity of point clouds. Recently, a variety of Transformers have been adopted to improve point cloud processing and display great potential. Nevertheless, large numbers of Transformer layers tend to incur huge computational and memory costs. PointNet++ is one of the most influential neural architectures for point cloud understanding. Although the accuracy of PointNet++ has been largely surpassed by recent networks, this does not mean that PointNet++ has no potential.Thus, this paper offer two major contributions that significantly improve PointNet++ performance. Firstly, we introduce a novel contextual feature extraction (CFE) block that significantly enhances the feature extraction capabilities of PointNet++ networks. Secondly, to further enhance feature fusion, we seamlessly integrate a mutual learning (ML) block into the network architecture. By embedding these two innovative blocks within each layer of the network, we not only enrich the network's functionality but also impart it with greater robustness and adaptability. The specific experiments were conducted on the S3DIS (6-fold cross-validation) and Modelnet40 datasets with 86.5% and 92.7% accuracy, respectively, which proved that our model is comparable or even better than most existing methods for classification and segmentation tasks.

Learning dental procedures is a complex task involving the development of fine motor skills. The reported use of theories and/ or evidence for designing learning activities to develop the fine motor skills needed for dental practice is limited. The aim of this review is to explore the available body of knowledge related to learning fine motor skills in dentistry. Evidence from studies investigating motor skill learning highlights the negative impact of self-focus and self-regulation on learning outcomes, particularly during the early stages of learning. The development of activities and schedules that enable novices to demonstrate characteristics similar to experts, without the reported long period of ‘deliberate practice’, is clearly of value. Outcomes of learning implicitly are important in dentistry because working under stressful conditions is common, either during undergraduate study or in practice. It is suggested that learning implicitly in the simulation stage can reduce disrupted performance when transitioning to clinical settings. Therefore, further investigation of effective methods for learning dental fine motor skills is indicated, using approaches that result in robust performance, even under stressful conditions.

This paper explores the application of machine learning (ML) in predicting functional recovery in patients with ischemic stroke. As technology advances, ML shows significant potential in the field of stroke medicine, especially in the areas of big data analytics and personalized medicine. Studies have shown that ML algorithms can improve the accuracy of stroke image analysis, subtype classification, risk assessment, treatment guidance, and prognosis prediction. However, the widespread use of ML still faces challenges such as data standardization, model validation, privacy, and bias. This paper reviews the current application status of ML in the field of stroke, discusses the challenges faced, and looks forward to the future development direction, aiming to promote the practical application of ML technology in the diagnosis and treatment of stroke to improve the prognosis and quality of life of patients.

This paper focuses on enhancing the object detection and decision-making capabilities of Autonomous Emergency Medical Response Systems (AEMRS). Using advanced sensors, Convolutional Neural Networks (CNN), and reinforcement learning, we propose a model that processes environmental data to identify obstacles and make optimal navigation decisions. The integration of these technologies aims to minimize response time and improve the efficiency of emergency medical services. The perception system utilizes radar, LiDAR, and camera inputs to create a comprehensive understanding of the environment. These data are processed through a series of CNN layers to detect and classify objects such as vehicles, pedestrians, and road signs. On the decision-making front, a Q-learning algorithm is employed to enable the ambulance to learn from its interactions with the environment, continuously improving its route planning and collision avoidance strategies. By combining these advanced AI techniques, the proposed AEMRS can significantly enhance the speed and reliability of emergency responses, ultimately saving more lives. This paper presents the design, implementation, and simulation results of the proposed system, demonstrating its potential to revolutionize emergency medical services.

Machine learning (ML) has transformed the financial industry by enabling advanced applications such as credit scoring, fraud detection, and market forecasting. At the core of this transformation is deep learning (DL), a subset of ML that is robust at processing and analyzing complex and large datasets. This paper provides a concise overview of key deep learning models, including Convolutional Neural Networks (CNNs), Long Short-Term Memory networks (LSTMs), Deep Belief Networks (DBNs), Transformers, Generative Adversarial Networks (GANs), and Deep Reinforcement Learning (Deep RL). The study examines their learning processes, mathematical foundations, and practical applications in finance. It also explores recent advances and emerging trends in the financial industry alongside critical challenges such as data quality, model interpretability, and computational complexity, offering insights into future research directions that can guide the development of more robust and explainable financial models.

The numerical implementation of the controllers allows the use of very complex algorithms with ease. However, in practice, due to its proven advantages, the PID controller (and its variants) is widely used in industrial control systems as well as in many other applications that require continuous control. Most of the methods for tuning the parameters of PID controllers are based on time-invariant linear models of the processes, which in practice can lead to poor performance of the control system. The paper presents an application of reinforcement learning algorithms in tuning of PID controllers for the control of some classes of continuous nonlinear systems. Tuning the parameters of PID controllers is done with the help of Twin Delayed Deep Deterministic Policy Gradients (TD3) algorithm which presents a series of advantages compared to other similar methods from Machine Learning dedicated to continuous state and action spaces. TD3 algorithm is an off-policy Actor-Critic based method and was used as it does not require a system model. The presented technique is applied for control of a biotechnological system which has a strongly nonlinear dynamic. The proposed tuning method is compared to the classical tuning methods of PID controllers. The performance of the tuning method based on the TD3 algorithm is demonstrated through simulation illustrating the effectiveness of the proposed methodology.

Ensuring precise segmentation of colorectal polyps holds critical importance in the early diagnosis and treatment of colorectal cancer. Nevertheless, existing deep learning-based segmentation methods are fully-supervised, requiring extensive precise manual pixel-level annotation data, which leads to high annotation costs. Additionally, it remains challenging to train large-scale segmentation models when confronted with limited colonoscopy data. To address these issues, we introduce the general segmentation foundation model—Segment Anything Model (SAM) into the field of medical image segmentation. Fine-tuning the foundation model is an effective approach to tackle sample scarcity. However, current SAM fine-tuning techniques still rely on precise annotations. To overcome this limitation, we propose WSPoly-SAM, a novel weakly-supervised approach for colonoscopy polyp segmentation. WSPoly-SAM utilizes weak annotations to guide SAM in generating segmentation masks, which are then treated as pseudo-labels to guide the fine-tuning of SAM, thereby reducing the dependence on precise annotations data. To improve the reliability and accuracy of pseudo-labels, we have designed a series of enhancement strategies to improve the quality of pseudo-labels and mitigate the negative impact of low-quality pseudo-labels. Experimental results on five medical image datasets demonstrate that WSPoly-SAM outperforms current fully-supervised mainstream polyp segmentation networks on the Kvasir-SEG, ColonDB, CVC-300, and ETIS datasets. Furthermore, by using different amounts of training data in weakly-supervised and fully-supervised experiments, it is found that weakly-supervised fine-tuning can save 70% to 73% of annotation time costs compared to fully-supervised fine-tuning. This study provides a new perspective on the combination of weakly-supervised learning and SAM models, significantly reducing annotation time and offering insights for further development in the field of colonoscopy polyp segmentation.

The world's growing population is highly dependent on animal agriculture. Animal products provide nutrient-packed meals that help to sustain individuals of all ages in communities across the globe. As the human demand for animal proteins grows, the agricultural industry must continue to advance its efficiency and quality of production. One of the most commonly farmed livestock is poultry and their significance is felt on a global scale. Current poultry farming practices result in the premature death and rejection of billions of chickens on an annual basis before they are processed for meat. This loss of life is concerning regarding animal welfare, agricultural efficiency, and economic impacts. The best way to prevent these losses is through the individualistic and/or group level assessment of animal on a continuous basis. On large-scale farms, such attention to detail was generally considered to be inaccurate and inefficient, but with the integration of Artificial Intelligence (AI) assisted technology individualized and per-herd assessments of livestock are possible and accurate. Various studies have shown cameras linked with specialized systems of AI can properly analyze flocks for health concerns, thus improving the survival rate and product quality of farmed poultry. Building on the recent advancements, this review explores the aspects of AI in the detection, counting and tracking of the poultry in commercial and research-based applications.

A hybrid smart process and material design system for nanoimprinting is proposed, which combines with a learning system based on experimental and numerical simulation results. Instead of carrying out extensive learning experiments for various condition, the simulation learning results are partially complimented where the results can be theoretically predicted by numerical simulation. In other word, the lacking data in experimental learning are complimented by simulation-based learning results. Therefore, the prediction of nanoimprint results under various conditions without experimental learning could be realized even for unknown materials. In this study, material and process design for a low-temperature nanoimprint process using glycerol-containing polyvinyl alcohol are demonstrated. Experimental results under limited conditions are learned to investigate optimum Glycerol concentrations and process temperatures. On the other hand, simulation-based learning is used to predict the dependence on press pressure and shape parameters. The prediction results for unknown Glycerol concentrations agreed well with the follow-up experiments.

Using pumps operating as turbines (PATs) offers the possibility of increasing the sustainability of water and energy systems by recovering the excess of energy that would be otherwise lost in pressure reducing valves or head loss chambers. In on-grid applications, there are many research works and implementations of PATs. However, there is still limited research for the optimization of efficiency and stability of PATs operating in off-grid systems. This work contributes to the development of stable direct current (DC) off-grid electric systems based on PATs, by optimizing and analysing the energy efficiency and stability for a wide range of operation. A self-excited induction generator (SEIG) coupled to the PAT is provided to cover the conventional type of electric ma-chines typically coupled to the hydraulic pumps. In this context, a methodology is proposed, based on the hydraulic, mechanical and electric subsystems, to define the PAT-SEIG operational area, to maximize energy conversion and the system efficiency. This will guarantee stable electric output quantities when operating in a DC off-grid system. In addition, an analytical model is proposed to estimate the PAT-SEIG operation under specific conditions. With this, water managers are suitable to design and optimize an off-grid PAT-SEIG system and to define the best hydraulic machines, electronic equipment, and all different control elements to maximize energy conversion within the target of operational limits. To develop and verify this new methodology, two micro PAT-SEIG setups were implemented in the hydraulic laboratory of IST/CERIS under typical operating conditions. The proposed solution proved to be resilient under a variable load regime. The system's maximum efficiency can be adapted using different capacitor values for the excitation of the SEIG, and the operational range is limited to the electric components. Considering the nominal efficiencies of the system’s components, the maximum p.u. efficiency obtained for each PAT-SEIG system were between 0.7 and 0.8 p.u.

The interest on the use of renewable energy resources is increasing, especially towards wind and hydro powers, which should be efficiently converted into electric energy via suitable technology tools. To this aim, data--driven control techniques represent viable strategies that can be employed for this purpose, due to the features of these nonlinear dynamic processes working over a wide range of operating conditions, driven by stochastic inputs, excitations and disturbances. Some of the considered methods, such as fuzzy and adaptive self--tuning controllers, were already verified on wind turbine systems, and similar advantages may thus derive from their appropriate implementation and application to hydroelectric plants. These issues represent the key features of the work, which provides some guidelines on the design and the application of these control strategies to these energy conversion systems. The working conditions of these systems will be also taken into account in order to highlight the reliability and robustness characteristics of the developed control strategies, especially interesting for remote and relatively inaccessible location of many installations.

Foods are complex products consisting of various ingredients of diverse origins. Along the food supply chains, food products are prone to spoilage and safety issues, which could give rise to different health-related concerns and outcomes. Furthermore, the existing highly centralised food systems generate substantial greenhouse gas emissions and food waste. In order to strengthen the sustainable decentralised "farm-to-fork" food chains, a mindset shift supported by relevant education and policy initiatives is highly required. The ERASMUS+ KA220 project SafeFood4EU was conceived with a crucial mission- to develop an interdisciplinary and innovative toolbox of higher education and lifelong learning courses that reflect various aspects of sustainable agri-food systems. The thematic areas discussed within the SafeFood4EU project have covered food safety and supply chain management, sustainable food systems and design, food production and quality of raw materials, food authenticity and analysis, and digital and soft skills. The main objectives have been to develop a distinctive content package and make it available to the students via an e-learning management system. The project's results, aimed at creating a pool of young and capable experts, can significantly impact future food security, thereby increasing awareness about the future challenges regarding food systems transition, dietary shift and the next generation's food security.

Artificial intelligence methods and application have recently shown great contribution in modeling and prediction of the hydrological processes, climate change, and earth systems. Among them, deep learning and machine learning methods mainly have reported being essential for achieving higher accuracy, robustness, efficiency, computation cost, and overall model performance. This paper presents the state of the art of machine learning and deep learning methods and applications in this realm and the current state, and future trends are discussed. The survey of the advances in machine learning and deep learning are presented through a novel classification of methods. The paper concludes that deep learning is still in the first stages of development, and the research is still progressing. On the other hand, machine learning methods are already established in the fields, and novel methods with higher performance are emerging through ensemble techniques and hybridization.

Many spatial decision support systems suffer from user adoption issues in practice due to lack of trust, technical expertise, and resources. Automated machine learning has recently allowed non-experts to explore and apply machine learning models in the industry without requiring abundant expert knowledge and resources. This paper reviews recent literature from 136 papers, and proposes a general framework for integrating spatial decision support systems with automated machine learning to lower major user adoption barriers. Challenges of data quality, model interpretability, and practical usefulness were discussed as general considerations for system implementation. Research opportunities related to spatially explicit models in AutoML, and resource-aware, collaborative/connected, and human-centered systems were also discussed to address these challenges. This paper argues that integrating spatial decision support systems with automated machine learning can not only encourage user adoption, but also mutually benefit research in both fields — bridging human-related and technical advancements for fostering future developments in spatial decision support systems and automated machine learning.