https://m.thaiware.com/tips/2138.html
AWS' TPU (tensor processing unit)/NPU service is AWS Trainium: https://aws.amazon.com/machine-learning/trainium/
https://m.thaiware.com/tips/2138.html
AWS' TPU (tensor processing unit)/NPU service is AWS Trainium: https://aws.amazon.com/machine-learning/trainium/
https://towardsdatascience.com/latent-dirichlet-allocation-lda-9d1cd064ffa2
A latent variable in machine learning refers to a variable that is not directly observed or measured but is inferred from the observable data. These variables represent hidden factors that influence the observed data and help explain patterns or relationships within that data.
### Examples and Applications:
1. **Principal Component Analysis (PCA):**
- In PCA, the principal components are latent variables that capture the directions of maximum variance in the data. These components summarize the data by reducing its dimensionality while preserving as much information as possible.
2. **Hidden Markov Models (HMM):**
- In HMMs, the hidden states are latent variables that represent the underlying process generating the observed sequence of data, such as the true emotional state of a person inferred from their speech or behavior.
3. **Latent Dirichlet Allocation (LDA):**
- In LDA, a topic model, the latent variables are the topics that explain the observed words in a collection of documents. Each document is assumed to be a mixture of these topics.
4. **Autoencoders:**
- In autoencoders, the encoded representation (bottleneck layer) is a latent variable that captures the most essential features of the input data, which is then used to reconstruct the original input.
https://mindsdb.com/
https://youtu.be/HMn1jTIbOTI
It integrates machine learning model into RDB to enable query of predicted value.
An approach to build (link&compile) and run applications on cloud.
Cloud native technologies focus on minimizing users' operational burden. Frequently, cloud-native applications are built as a set of microservices (REST API) that run in Docker containers, and may be orchestrated in Kubernetes and managed and deployed using DevOps and Git CI workflows (although there is a large amount of competing open source that supports cloud-native development). The advantage of using Docker containers is the ability to package all software needed to execute into one executable package.
[๑๔๘] ดูกรภิกษุทั้งหลาย สัปปุริสทาน ๕ ประการนี้ ๕ ประการเป็นไฉน คือ
สัตบุรุษย่อมให้ทานด้วยศรัทธา ๑พระไตรปิฎก เล่มที่ ๒๒ พระสุตตันตปิฎก เล่มที่ ๑๔ อังคุตตรนิกาย ปัญจก-ฉักกนิบาต
Cloud-Edge-End architecture :
With the increasing production of Big Data and due to latency, privacy, and other concerns, a Cloud-Edge-End computing paradigm has emerged in order to facilitate Big Data processing in proper places. This infrastructure seamlessly integrates hardware and software resources across multiple computing tiers, from the End to Edge, and to the Cloud. The flexibility of hierarchical cloud-edge-end computing architecture makes possible to decide whether data processing and analysis—including data cleaning, machine learning training, and decision making—applied to data coming from end sensors is carried out directly at the end device in-place, the computing edge or uploaded to the cloud infrastructures with higher computation capabilities. Therefore, advanced cloud–edge–end computing architectures needs to provide the kind of support that IoT applications need to deploy data processing and analytic methods in a flexible, efficient and scalable way. (cf. https://www.journals.elsevier.com/journal-of-systems-architecture/call-for-papers/special-issue-on-cloud-edge-end-architecture-for-internet-of-things-applications-vsi-cloud-edge-end-iot)
So the term End refers to end devices and the term Edge refers to network edge.
However, the term Cloud-Fog-Edge is found more on Google.
A cloud service that emulates mobile OS. It's like a VM with mobile OS installed. Then VM can run on any computer platforms just like any cloud services. Examples include https://www.cloudemulator.net/
An approach to machine learning that combines a small amount of labeled data with a large amount of unlabeled data during training.
ในส่วนของ unlabeled data จะถูกสร้าง label ให้โดยเทียบเคียงจาก labeled data โดยวิธี เช่น cluster assumption คืออยู่ใน cluster เดียวกันก็น่าจะมี label เดียวกัน
A licensed enterprise information management software ที่มีความสามารถทำ document classification ได้ แต่ผู้ใช้ต้องเลือก segment บนรูปเอกสารก่อนเพื่อใช้ทำ classification
https://archive-beta.ics.uci.edu/ml/datasets
https://datasetsearch.research.google.com/
https://datahub.io/collections
https://elsevier.digitalcommonsdata.com/collections/e9797bf7-f3e6-4500-9d6f-aac6f9491859
Supplemental info in open access journal e.g.Peerj allows public accesses to paper data sets and codes
Data sources: https://www.reddit.com/subreddits/ e.g. r/Mental Health
สำหรับใช้โดยคนในห้องประชุมแบบ onsite ที่เข้าร่วมประชุม google meet แบบ hybrid คือมีบางคนประชุมแบบ remote ซึ่งต้องใช้ google meet ใน mode ปกติ
ทำให้ remote participants ได้ยินเสียงคนในห้องประชุมปกติ แต่คนในห้องประชุมจะไม่ได้ยินเสียงต้นที่ผ่านเข้าไปใน google meet companion mode ออกมากจากอุปกรณ์ของผู้เข้าร่วมประชุม onsite คนอื่นๆ ทำให้ไม่ echo (no voice feedback)
RL learns from interaction rather than labeled data, the core idea of gradually improving performance through experience.
The agent tries actions, observes results (state transitions and rewards), and updates its knowledge or policy.
Over time, it learns which actions lead to better outcomes.
Just like in supervised learning, the model (e.g., Q-table, neural network) has parameters (weights).
During training, these parameters are updated to minimize a loss function (e.g., temporal difference error in Q-learning or prediction loss in DQNs).
In training, the agent often explores new actions (e.g., epsilon-greedy strategy) to improve learning.
In the final (deployment) phase, it mainly exploits the learned policy.
====
There are many algorithms for reinforcement learning, please see https://en.wikipedia.org/wiki/Reinforcement_learning
Well-known algorithm is Q-learning.
Reinforcement learning involves an agent, a set of states , and a set
of actions per state. By performing an action
, the agent transitions from state to state. Executing an action in a specific state provides the agent with a reward (a numerical score).
--ChatGPT
Snake game:
You want the agent (snake) to learn how to survive and grow longer by playing many games.
The environment (game board) provides feedback through rewards (e.g., +1 for eating food, -1 for dying).
You want the AI to develop strategies like avoiding collisions, planning moves, or maximizing score over time.
Neural network used in DQN for Snake game:
Input: a representation of the environment’s state.
1.Grid input
Treat the snake game board as a matrix (like an image).
Input:
0 = empty cell
1 = snake body
2 = snake head
3 = food
If the board is 20×20 → the input is 20×20 matrix (sometimes flattened into 400 values).
Neural nets for this usually use CNNs (like in Atari DQN).
2. Features Vector
Simpler and often more efficient. Common features:
[Snake head position,Food position,
Relative position of food,
Snake direction (one-hot: [up, down, left, right]),
Danger information (is there a wall or body in the next cell up/down/left/right?),
Snake length]
Output: estimated Q-values for all possible actions .
A vector of 4 Q values, each for moving up, down, left, right.