paper-with-me

홈 › Papers

Transfer Learning for Power Outage Detection Task with Limited Training Data

2023-05-28 · Olukunle Owolabi

Early detection of power outages is crucial for maintaining a reliable power distribution system. This research investigates the use of transfer learning and language models in detecting outages with limited labeled data. By leveraging pretraining and transfer learning, models can generalize to unseen classes. Using a curated balanced dataset of social media tweets related to power outages, we conducted experiments using zero-shot and few-shot learning. Our hypothesis is that Language Models pretrained with limited data could achieve high performance in outage detection tasks over baseline models. Results show that while classical models outperform zero-shot Language Models, few-shot fine-tuning significantly improves their performance. For example, with 10% fine-tuning, BERT achieves 81.3% accuracy (+15.3%), and GPT achieves 74.5% accuracy (+8.5%). This has practical implications for analyzing and localizing outages in scenarios with limited data availability. Our evaluation provides insights into the potential of few-shot fine-tuning with Language Models for power outage detection, highlighting their strengths and limitations. This research contributes to the knowledge base of leveraging advanced natural language processing techniques for managing critical infrastructure.

📄 PDF Abstract BibTeX arXiv:2305.17817

Code (0)

등록된 구현이 없습니다.

Tasks

Few-Shot LearningTransfer Learning

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
WordPiece 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

A Control Chart Approach to Power System Line Outage Detection Under Transient Dynamics

2020-05-22

Online transmission line outage detection over the entire network enables timely corrective action to be taken, which prevents a local event from cascading into a large scale blackout. Line outage detection aims to detec…

Change Detection

Fast Distribution Grid Line Outage Identification with $μ$PMU

2018-11-14 · Yizheng Liao, Yang Weng, Chin-Woo Tan, Ram Rajagopal

The growing integration of distributed energy resources (DERs) in urban distribution grids raises various reliability issues due to DER's uncertain and complex behaviors. With a large-scale DER penetration, traditional o…

Change Point DetectionTime SeriesTime Series Analysis

Optimal Placement of Limited PMUs for Transmission Line Outage Detection and Identification

2020-05-14

Phasor Measurement Unit (PMU) technology is increasingly used for real-time monitoring applications, especially line outage detection and identification (D&I) in the power system. Current outage D&I schemes either assume…

Assessing Electricity Service Unfairness with Transfer Counterfactual Learning

2023-10-05 · Song Wei, Xiangrui Kong, Alinson Santos Xavier, Shixiang Zhu 외

Energy justice is a growing area of interest in interdisciplinary energy research. However, identifying systematic biases in the energy sector remains challenging due to confounding variables, intricate heterogeneity in …

AttributecounterfactualTransfer Learning

LASSO-Based Multiple-Line Outage Identification In Partially Observable Power Systems

2022-06-05 · Xiaozhou Yang, Nan Chen

Phasor measurement units (PMUs) create ample real-time monitoring opportunities for modern power systems. Among them, line outage detection and identification remains a crucial but challenging task. Current works on outa…