Skip to main navigation Skip to search Skip to main content

Advertising Impression Resource Allocation Strategy with Multi-Level Budget Constraint DQN in Real-Time Bidding

  • Chengwei Zhang
  • , Kangjie Zheng
  • , Yu Tian
  • , Wanli Xue
  • , Tianpei Yang
  • , Dou An
  • , Yongqi Pi
  • , Rong Chen
  • Dalian Maritime University
  • Tianjin University of Technology
  • Tianjin University

Research output: Contribution to journal › Article › peer-review

10 Scopus citations

Abstract

How to allocate advertising impressions under budget constraint is one of the leading research issues in Real-Time Bidding (RTB). Traditional methods are mostly grounded on ‘the highest bidder rule’ to optimize revenues of AD Exchange (ADX), which causes Demand Side Platforms (DSPs) to over-consume budget in the early stage and eventually lead to bad revenue of all trading parties. In addition, the long auction sequence in large-scale RTB environments may also bring challenges to existing algorithms. To those problems, we propose a Multi-Level Budget Constraint DQN (MLBC-DQN) framework, which divides the long sequence in RTB environment into several short sequence environments with different budgets’ level and use a deep Q network (DQN) to learn optimal strategy for environments of each level. The final strategy to interact with the original RTB environment of MLBC-DQN is weighted by strategies of all DQNs mentioned above. By weighing various strategies from different perspectives, an MLBC-DQN agent can quickly learn effective strategies to overcome the over-consume budget problem. We evaluate MLBC-DQN in two datasets comparing with traditional allocation strategies and DQN. Results show that the MLBC-DQN can achieve higher revenues of DSPs without prejudice to the income of ADX, and promote the marketing effect of advertising resources.

Original languageEnglish
Pages (from-to)647-656
Number of pages10
JournalNeurocomputing
Volume488
DOIs
StatePublished - 1 Jun 2022

Keywords

  • Advertising impression allocation
  • DQN
  • MLBC-DQN
  • RTB

Fingerprint

Dive into the research topics of 'Advertising Impression Resource Allocation Strategy with Multi-Level Budget Constraint DQN in Real-Time Bidding'. Together they form a unique fingerprint.

Cite this