Abstract
For a successful automated negotiation, a vital issue is how well the agent can learn the latent preferences of opponents. Opponents however in most practical cases would be unwilling to reveal their true preferences for exploitation reasons. Existing approaches tend to resolve this issue by learning opponents through their observations during negotiation. While useful, it is hard because of the indirect way the target function can be observed as well as the limited amount of experience available to learn from. This situation becomes even worse when it comes to negotiation problems with large outcome space. In this work, a new model is proposed in which the agents can not only negotiate with others, but also provide information (e.g., labels) about whether an offer is accepted or rejected by a specific agent. In particular, we consider that there is a crowd of agents that can present labels on offers for certain payment; moreover, the collected labels are assumed to be noisy, due to the lack of expert knowledge and/or the prevalence of spammers, etc. Therefore to respond to the challenges, we introduce a novel negotiation approach that (1) adaptively sets the aspiration level on the basis of estimated opponent concession; (2) assigns labeling tasks to the crowd using online primal-dual techniques, such that the overall budget can be both minimized with sufficiently low errors; (3) decides, at every stage of the negotiation, the best possible offer to be proposed.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Baarslag, T., Fujita, K., Gerding, E.H., Hindriks, K.V., Ito, T., Jennings, N.R., Jonker, C.M., Kraus, S., Lin, R., Robu, V., Williams, C.R.: Evaluating practical negotiating agents: results and analysis of the 2011 international competition. Artif. Intell. 198, 73–103 (2013)
Buchbinder, N., Naor, J.: Online primal-dual algorithms for covering and packing. Math. Oper. Res. 34(2), 270–286 (2009)
Chen, S., Ammar, H.B., Tuyls, K., Weiss, G.: Optimizing complex automated negotiation using sparse pseudo-input Gaussian processes. In: Proceedings of the 12th International Joint Conference on Autonomous Agents and Multi-agent Systems, Saint Paul, Minnesota, USA, pp. 707–714. ACM (2013)
Chen, S., Ammar, H.B., Tuyls, K., Weiss, G.: Using conditional restricted Boltzmann machine for highly competitive negotiation tasks. In: Proceedings of the 23th International Joint Conference on Artificial Intelligence, pp. 69–75. AAAI Press (2013)
Chen, S., Hao, J., Zili, Z., Weiss, G., Zhou, S.: Toward efficient agreements in real-time multilateral agent-based negotiations. In: 27th IEEE International Conference on Tools with Artificial Intelligence, pp. 896–903. IEEE Computer Society (2015)
Chen, S., Weiss, G.: An efficient and adaptive approach to negotiation in complex environments. In: Proceedings of the 20th European Conference on Artificial Intelligence, Montpellier, France, pp. 228–233. IOS Press (2012)
Chen, S., Weiss, G.: An efficient automated negotiation strategy for complex environments. Eng. Appl. Artif. Intell. 26(10), 2613–2623 (2013)
Chen, S., Weiss, G.: An intelligent agent for bilateral negotiation with unknown opponents in continuous-time domains. ACM Trans. Auton. Adapt. Syst. 9(3), 16:1–16:24 (2014)
Chen, S., Weiss, G.: An approach to complex agent-based negotiations via effectively modeling unknown opponents. Expert Syst. Appl. 42(5), 2287–2304 (2015)
Duan, L., Dogru, M.K., Ozen, U., Beck, J.: A negotiation framework for linked combinatorial optimization problems. Expert Syst. Appl. 25(1), 158–182 (2012)
Hao, J., Song, S., Leung, H.-F., Ming, Z.: An efficient and robust negotiating strategy in bilateral negotiations over multiple items. Eng. Appl. Artif. Intell. 34, 45–57 (2014)
Ho, C.-J., Jabbari, S., Vaughan, J.W.: Adaptive task assignment for crowdsourced classification. In: Proceedings of the 30th International Conference on Machine Learning (ICML 2013), pp. 534–542 (2013)
Jennings, N.R., Faratin, P., Lomuscio, A.R., Parsons, S., Sierra, C., Wooldridge, M.: Automated negotiation: prospects, methods and challenges. Eng. Appl. Artif. Intell. 10(2), 199–215 (2001)
Karger, D.R., Oh, S., Shah, D.: Iterative learning for reliable crowdsourcing systems. In: Advances in Neural Information Processing Systems, pp. 1953–1961 (2011)
Lopes, F., Wooldridge, M., Novais, A.: Negotiation among autonomous computational agents: principles, analysis and challenges. Artif. Intell. Rev. 29, 1–44 (2008)
Mor, Y., Goldman, C.V., Rosenschein, J.S.: Learn your opponent’s strategy (in polynomial time)!. In: Weiss, G., Sen, S. (eds.) IJCAI-WS 1995. LNCS, vol. 1042, pp. 164–176. Springer, Heidelberg (1996)
Osborne, M., Rubinstein, A.: A Course in Game Theory. MIT Press, Cambridge (1994)
Raiffa, H.: The Art and Science of Negotiation. Harvard University Press, Cambridge (1982)
Sanchez-Anguix, V., Julian, V., Botti, V., Garcła-Fornes, A.: Tasks for agent-based negotiation teams: analysis, review, and challenges. Eng. Appl. Artif. Intell. 26(10), 2480–2494 (2013)
Weiss, G. (ed.): Multiagent Systems, 2nd edn. MIT Press, Cambridge (2013)
Williams, C.R., Robu, V., Gerding, E.H., Jennings, N.R.: Negotiating concurrently with unkown opponents in complex, real-time domains. In: Proceedings of the 20th European Conference on Artificial Intelligence, pp. 834–839 (2012)
Zhang, Y., Chen, X., Zhou, D., Jordan, M.I.: Spectral methods meet EM: a provably optimal algorithm forcrowdsourcing. In: Advances in Neural Information Processing Systems, pp. 1260–1268 (2014)
Acknowledgements
This work is supported by Southwest University and Fundamental Research Funds for the Central Universities (Grant number: SWU115032, XDJK2016C042). Special thanks also go to the anonymous reviewers of this article for their valuable comments.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Chen, S., Weiss, G., Zhou, S. (2016). Solving Negotiation Problems Against Unknown Opponents with Wisdom of Crowds. In: Friedrich, G., Helmert, M., Wotawa, F. (eds) KI 2016: Advances in Artificial Intelligence. KI 2016. Lecture Notes in Computer Science(), vol 9904. Springer, Cham. https://doi.org/10.1007/978-3-319-46073-4_10
Download citation
DOI: https://doi.org/10.1007/978-3-319-46073-4_10
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46072-7
Online ISBN: 978-3-319-46073-4
eBook Packages: Computer ScienceComputer Science (R0)