Types of Transfer Learning
Types of Transfer Learning
Transfer learning can be categorized based on the relationship between source and target domains and tasks:
1. Inductive Transfer Learning:
- The target task is different from the source task;
- Example: using an image classifier trained on animals to classify medical images.
2. Transductive Transfer Learning:
- The source and target tasks are the same, but the domains differ;
- Example: sentiment analysis on English reviews (source) and French reviews (target).
3. Unsupervised Transfer Learning:
- Both tasks are unsupervised (e.g., clustering), but domains differ.
Notation:
DSβTSββξ =DTβξ =TTββ(domainsΒ differ)(tasksΒ differ)βFeature reuse: often, early layers of a neural network learn general features (e.g., edges in images) that can be reused across tasks.
The choice of transfer learning type depends on how similar the source and target domains and tasks are.
Thanks for your feedback!
Ask AI
Ask AI
Ask anything or try one of the suggested questions to begin our chat
Awesome!
Completion rate improved to 9.09
Types of Transfer Learning
Swipe to show menu
Types of Transfer Learning
Transfer learning can be categorized based on the relationship between source and target domains and tasks:
1. Inductive Transfer Learning:
- The target task is different from the source task;
- Example: using an image classifier trained on animals to classify medical images.
2. Transductive Transfer Learning:
- The source and target tasks are the same, but the domains differ;
- Example: sentiment analysis on English reviews (source) and French reviews (target).
3. Unsupervised Transfer Learning:
- Both tasks are unsupervised (e.g., clustering), but domains differ.
Notation:
DSβTSββξ =DTβξ =TTββ(domainsΒ differ)(tasksΒ differ)βFeature reuse: often, early layers of a neural network learn general features (e.g., edges in images) that can be reused across tasks.
The choice of transfer learning type depends on how similar the source and target domains and tasks are.
Thanks for your feedback!