Hybrid Encoder: Towards Efficient And Precise Native Adsrecommendation Via Hybrid Transformer Encoding Networks

Abstract

Transformer encoding networks have been proved to be a powerful tool of understanding natural languages. They are playing a critical role in native ads service, which facilitates the recommendation of appropriate ads based on user's web browsing history. For the sake of efficient recommendation, conventional methods would generate user and advertisement embeddings independently with a siamese transformer encoder, such that approximate nearest neighbour search (ANN) can be leveraged. Given that the underlying semantic about user and ad can be complicated, such independently generated embeddings are prone to information loss, which leads to inferior recommendation quality. Although another encoding strategy, the cross encoder, can be much more accurate, it will lead to huge running cost and become infeasible for realtime services, like native ads recommendation. In this work, we propose hybrid encoder, which makes efficient and precise native ads recommendation through two consecutive st

Stats

• citations0
• S2 citations—
• github stars0
• HF likes0
• heat score0.00
• arxiv keyyang2021hybrid

Related papers

• Async Learned User Embeddings For Ads Delivery Optimization (2024)0.00
• Shallow Cross-encoders For Low-latency Retrieval (2024)2.26
• Thinking Fast And Slow: Efficient Text-to-visual Retrieval With Transformers (2021)15.16
• An Efficient Embedding Based Ad Retrieval With Gpu-powered Feature Interaction (2025)0.00
• Efficient K-nn Search With Cross-encoders Using Adaptive Multi-round CUR Decomposition (2023)0.00
• Pfeed: Generating Near Real-time Personalized Feeds Using Precomputed Embedding Similarities (2024)0.00
• Hierarchical Structured Neural Network: Efficient Retrieval Scaling For Large Scale Recommendation (2024)0.00
• Connecting Compression Spaces With Transformer For Approximate Nearest Neighbor Search (2021)4.52