projects / deliverable / binutils-gdb.git / blame
? search:
summary | shortlog | log | commit | commitdiff | tree
blob | blame (incremental) | history | HEAD
Use unique_xmalloc_ptr in Python code
[deliverable/binutils-gdb.git] / bfd / elfnn-aarch64.c
CommitLineData
cec5225b 1/* AArch64-specific support for NN-bit ELF.
6f2750fe 2 Copyright (C) 2009-2016 Free Software Foundation, Inc.
a06ea964
NC		 3 Contributed by ARM Ltd.
4
5 This file is part of BFD, the Binary File Descriptor library.
6
7 This program is free software; you can redistribute it and/or modify
8 it under the terms of the GNU General Public License as published by
9 the Free Software Foundation; either version 3 of the License, or
10 (at your option) any later version.
11
12 This program is distributed in the hope that it will be useful,
13 but WITHOUT ANY WARRANTY; without even the implied warranty of
14 MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
15 GNU General Public License for more details.
16
17 You should have received a copy of the GNU General Public License
18 along with this program; see the file COPYING3. If not,
19 see <http://www.gnu.org/licenses/>. */
20
21/* Notes on implementation:
22
23 Thread Local Store (TLS)
24
25 Overview:
26
27 The implementation currently supports both traditional TLS and TLS
28 descriptors, but only general dynamic (GD).
29
30 For traditional TLS the assembler will present us with code
31 fragments of the form:
32
33 adrp x0, :tlsgd:foo
34 R_AARCH64_TLSGD_ADR_PAGE21(foo)
35 add x0, :tlsgd_lo12:foo
36 R_AARCH64_TLSGD_ADD_LO12_NC(foo)
37 bl __tls_get_addr
38 nop
39
40 For TLS descriptors the assembler will present us with code
41 fragments of the form:
42
418009c2 43 adrp x0, :tlsdesc:foo R_AARCH64_TLSDESC_ADR_PAGE21(foo)
a06ea964
NC		 44 ldr x1, [x0, #:tlsdesc_lo12:foo] R_AARCH64_TLSDESC_LD64_LO12(foo)
45 add x0, x0, #:tlsdesc_lo12:foo R_AARCH64_TLSDESC_ADD_LO12(foo)
46 .tlsdesccall foo
47 blr x1 R_AARCH64_TLSDESC_CALL(foo)
48
49 The relocations R_AARCH64_TLSGD_{ADR_PREL21,ADD_LO12_NC} against foo
50 indicate that foo is thread local and should be accessed via the
51 traditional TLS mechanims.
52
a6bb11b2 53 The relocations R_AARCH64_TLSDESC_{ADR_PAGE21,LD64_LO12_NC,ADD_LO12_NC}
a06ea964
NC		 54 against foo indicate that 'foo' is thread local and should be accessed
55 via a TLS descriptor mechanism.
56
57 The precise instruction sequence is only relevant from the
58 perspective of linker relaxation which is currently not implemented.
59
60 The static linker must detect that 'foo' is a TLS object and
61 allocate a double GOT entry. The GOT entry must be created for both
62 global and local TLS symbols. Note that this is different to none
63 TLS local objects which do not need a GOT entry.
64
65 In the traditional TLS mechanism, the double GOT entry is used to
66 provide the tls_index structure, containing module and offset
a6bb11b2 67 entries. The static linker places the relocation R_AARCH64_TLS_DTPMOD
a06ea964
NC		 68 on the module entry. The loader will subsequently fixup this
69 relocation with the module identity.
70
71 For global traditional TLS symbols the static linker places an
a6bb11b2 72 R_AARCH64_TLS_DTPREL relocation on the offset entry. The loader
a06ea964
NC		 73 will subsequently fixup the offset. For local TLS symbols the static
74 linker fixes up offset.
75
76 In the TLS descriptor mechanism the double GOT entry is used to
77 provide the descriptor. The static linker places the relocation
78 R_AARCH64_TLSDESC on the first GOT slot. The loader will
79 subsequently fix this up.
80
81 Implementation:
82
83 The handling of TLS symbols is implemented across a number of
84 different backend functions. The following is a top level view of
85 what processing is performed where.
86
87 The TLS implementation maintains state information for each TLS
88 symbol. The state information for local and global symbols is kept
89 in different places. Global symbols use generic BFD structures while
90 local symbols use backend specific structures that are allocated and
91 maintained entirely by the backend.
92
93 The flow:
94
cec5225b 95 elfNN_aarch64_check_relocs()
a06ea964
NC		 96
97 This function is invoked for each relocation.
98
99 The TLS relocations R_AARCH64_TLSGD_{ADR_PREL21,ADD_LO12_NC} and
a6bb11b2 100 R_AARCH64_TLSDESC_{ADR_PAGE21,LD64_LO12_NC,ADD_LO12_NC} are
a06ea964
NC		 101 spotted. One time creation of local symbol data structures are
102 created when the first local symbol is seen.
103
104 The reference count for a symbol is incremented. The GOT type for
105 each symbol is marked as general dynamic.
106
cec5225b 107 elfNN_aarch64_allocate_dynrelocs ()
a06ea964
NC		 108
109 For each global with positive reference count we allocate a double
110 GOT slot. For a traditional TLS symbol we allocate space for two
111 relocation entries on the GOT, for a TLS descriptor symbol we
112 allocate space for one relocation on the slot. Record the GOT offset
113 for this symbol.
114
cec5225b 115 elfNN_aarch64_size_dynamic_sections ()
a06ea964
NC		 116
117 Iterate all input BFDS, look for in the local symbol data structure
118 constructed earlier for local TLS symbols and allocate them double
119 GOT slots along with space for a single GOT relocation. Update the
120 local symbol structure to record the GOT offset allocated.
121
cec5225b 122 elfNN_aarch64_relocate_section ()
a06ea964 123
cec5225b 124 Calls elfNN_aarch64_final_link_relocate ()
a06ea964
NC		 125
126 Emit the relevant TLS relocations against the GOT for each TLS
127 symbol. For local TLS symbols emit the GOT offset directly. The GOT
128 relocations are emitted once the first time a TLS symbol is
129 encountered. The implementation uses the LSB of the GOT offset to
130 flag that the relevant GOT relocations for a symbol have been
131 emitted. All of the TLS code that uses the GOT offset needs to take
132 care to mask out this flag bit before using the offset.
133
cec5225b 134 elfNN_aarch64_final_link_relocate ()
a06ea964
NC		 135
136 Fixup the R_AARCH64_TLSGD_{ADR_PREL21, ADD_LO12_NC} relocations. */
137
138#include "sysdep.h"
139#include "bfd.h"
140#include "libiberty.h"
141#include "libbfd.h"
142#include "bfd_stdint.h"
143#include "elf-bfd.h"
144#include "bfdlink.h"
1419bbe5 145#include "objalloc.h"
a06ea964 146#include "elf/aarch64.h"
caed7120 147#include "elfxx-aarch64.h"
a06ea964 148
cec5225b
YZ		 149#define ARCH_SIZE NN
150
151#if ARCH_SIZE == 64
152#define AARCH64_R(NAME) R_AARCH64_ ## NAME
153#define AARCH64_R_STR(NAME) "R_AARCH64_" #NAME
a6bb11b2
YZ		 154#define HOWTO64(...) HOWTO (__VA_ARGS__)
155#define HOWTO32(...) EMPTY_HOWTO (0)
cec5225b
YZ		 156#define LOG_FILE_ALIGN 3
157#endif
158
159#if ARCH_SIZE == 32
160#define AARCH64_R(NAME) R_AARCH64_P32_ ## NAME
161#define AARCH64_R_STR(NAME) "R_AARCH64_P32_" #NAME
a6bb11b2
YZ		 162#define HOWTO64(...) EMPTY_HOWTO (0)
163#define HOWTO32(...) HOWTO (__VA_ARGS__)
cec5225b
YZ		 164#define LOG_FILE_ALIGN 2
165#endif
166
a6bb11b2 167#define IS_AARCH64_TLS_RELOC(R_TYPE) \
4c0a9a6f
JW		 168 ((R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC \
169 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21 \
3c12b054 170 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADR_PREL21 \
3e8286c0 171 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC \
1aa66fb1 172 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_MOVW_G1 \
a6bb11b2 173 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21 \
a6bb11b2 174 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC \
4c0a9a6f 175 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC \
a6bb11b2 176 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19 \
4c0a9a6f
JW		 177 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC \
178 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1 \
6ffe9a1b 179 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_HI12 \
40fbed84 180 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12 \
753999c1 181 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12_NC \
73f925cc 182 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC \
f69e4920 183 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21 \
77a69ff8 184 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADR_PREL21 \
07c9aa07
JW		 185 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_LDST16_DTPREL_LO12 \
186 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_LDST16_DTPREL_LO12_NC \
187 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_LDST32_DTPREL_LO12 \
188 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_LDST32_DTPREL_LO12_NC \
189 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_LDST64_DTPREL_LO12 \
190 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_LDST64_DTPREL_LO12_NC \
191 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_LDST8_DTPREL_LO12 \
192 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_LDST8_DTPREL_LO12_NC \
6ffe9a1b
JW		 193 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G0 \
194 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G0_NC \
195 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G1 \
196 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G1_NC \
197 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G2 \
a6bb11b2 198 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12 \
4c0a9a6f 199 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12 \
a6bb11b2 200 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC \
a6bb11b2
YZ		 201 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0 \
202 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC \
4c0a9a6f
JW		 203 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1 \
204 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC \
205 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2 \
a6bb11b2
YZ		 206 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_DTPMOD \
207 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_DTPREL \
208 || (R_TYPE) == BFD_RELOC_AARCH64_TLS_TPREL \
a06ea964
NC		 209 || IS_AARCH64_TLSDESC_RELOC ((R_TYPE)))
210
9331eea1 211#define IS_AARCH64_TLS_RELAX_RELOC(R_TYPE) \
0484b454
RL		 212 ((R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADD \
213 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC \
4af68b9c
JW		 214 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21 \
215 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21 \
216 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_CALL \
217 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD_PREL19 \
218 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC \
0484b454
RL		 219 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LDR \
220 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC \
221 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_OFF_G1 \
222 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LDR \
4af68b9c 223 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21 \
9331eea1
JW		 224 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADR_PREL21 \
225 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC \
ac734732
RL		 226 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC \
227 || (R_TYPE) == BFD_RELOC_AARCH64_TLSGD_MOVW_G1 \
9331eea1
JW		 228 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21 \
229 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19 \
230 || (R_TYPE) == BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC \
259364ad
JW		 231 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC \
232 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21 \
4af68b9c 233 || (R_TYPE) == BFD_RELOC_AARCH64_TLSLD_ADR_PREL21)
9331eea1 234
a6bb11b2 235#define IS_AARCH64_TLSDESC_RELOC(R_TYPE) \
4c0a9a6f
JW		 236 ((R_TYPE) == BFD_RELOC_AARCH64_TLSDESC \
237 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADD \
238 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC \
a6bb11b2 239 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21 \
389b8029 240 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21 \
4c0a9a6f 241 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_CALL \
a6bb11b2 242 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC \
4c0a9a6f 243 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC \
a6bb11b2 244 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LDR \
4c0a9a6f
JW		 245 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_LD_PREL19 \
246 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC \
247 || (R_TYPE) == BFD_RELOC_AARCH64_TLSDESC_OFF_G1)
a06ea964
NC		 248
249#define ELIMINATE_COPY_RELOCS 0
250
a06ea964 251/* Return size of a relocation entry. HTAB is the bfd's
cec5225b
YZ		 252 elf_aarch64_link_hash_entry. */
253#define RELOC_SIZE(HTAB) (sizeof (ElfNN_External_Rela))
a06ea964 254
cec5225b
YZ		 255/* GOT Entry size - 8 bytes in ELF64 and 4 bytes in ELF32. */
256#define GOT_ENTRY_SIZE (ARCH_SIZE / 8)
a06ea964
NC		 257#define PLT_ENTRY_SIZE (32)
258#define PLT_SMALL_ENTRY_SIZE (16)
259#define PLT_TLSDESC_ENTRY_SIZE (32)
260
a06ea964
NC		 261/* Encoding of the nop instruction */
262#define INSN_NOP 0xd503201f
263
264#define aarch64_compute_jump_table_size(htab) \
265 (((htab)->root.srelplt == NULL) ? 0 \
266 : (htab)->root.srelplt->reloc_count * GOT_ENTRY_SIZE)
267
268/* The first entry in a procedure linkage table looks like this
269 if the distance between the PLTGOT and the PLT is < 4GB use
270 these PLT entries. Note that the dynamic linker gets &PLTGOT[2]
271 in x16 and needs to work out PLTGOT[1] by using an address of
cec5225b
YZ		 272 [x16,#-GOT_ENTRY_SIZE]. */
273static const bfd_byte elfNN_aarch64_small_plt0_entry[PLT_ENTRY_SIZE] =
a06ea964
NC		 274{
275 0xf0, 0x7b, 0xbf, 0xa9, /* stp x16, x30, [sp, #-16]! */
276 0x10, 0x00, 0x00, 0x90, /* adrp x16, (GOT+16) */
caed7120 277#if ARCH_SIZE == 64
a06ea964
NC		 278 0x11, 0x0A, 0x40, 0xf9, /* ldr x17, [x16, #PLT_GOT+0x10] */
279 0x10, 0x42, 0x00, 0x91, /* add x16, x16,#PLT_GOT+0x10 */
caed7120
YZ		 280#else
281 0x11, 0x0A, 0x40, 0xb9, /* ldr w17, [x16, #PLT_GOT+0x8] */
282 0x10, 0x22, 0x00, 0x11, /* add w16, w16,#PLT_GOT+0x8 */
283#endif
a06ea964
NC		 284 0x20, 0x02, 0x1f, 0xd6, /* br x17 */
285 0x1f, 0x20, 0x03, 0xd5, /* nop */
286 0x1f, 0x20, 0x03, 0xd5, /* nop */
287 0x1f, 0x20, 0x03, 0xd5, /* nop */
288};
289
290/* Per function entry in a procedure linkage table looks like this
291 if the distance between the PLTGOT and the PLT is < 4GB use
292 these PLT entries. */
cec5225b 293static const bfd_byte elfNN_aarch64_small_plt_entry[PLT_SMALL_ENTRY_SIZE] =
a06ea964
NC		 294{
295 0x10, 0x00, 0x00, 0x90, /* adrp x16, PLTGOT + n * 8 */
caed7120 296#if ARCH_SIZE == 64
a06ea964
NC		 297 0x11, 0x02, 0x40, 0xf9, /* ldr x17, [x16, PLTGOT + n * 8] */
298 0x10, 0x02, 0x00, 0x91, /* add x16, x16, :lo12:PLTGOT + n * 8 */
caed7120
YZ		 299#else
300 0x11, 0x02, 0x40, 0xb9, /* ldr w17, [x16, PLTGOT + n * 4] */
301 0x10, 0x02, 0x00, 0x11, /* add w16, w16, :lo12:PLTGOT + n * 4 */
302#endif
a06ea964
NC		 303 0x20, 0x02, 0x1f, 0xd6, /* br x17. */
304};
305
306static const bfd_byte
cec5225b 307elfNN_aarch64_tlsdesc_small_plt_entry[PLT_TLSDESC_ENTRY_SIZE] =
a06ea964
NC		 308{
309 0xe2, 0x0f, 0xbf, 0xa9, /* stp x2, x3, [sp, #-16]! */
310 0x02, 0x00, 0x00, 0x90, /* adrp x2, 0 */
311 0x03, 0x00, 0x00, 0x90, /* adrp x3, 0 */
caed7120
YZ		 312#if ARCH_SIZE == 64
313 0x42, 0x00, 0x40, 0xf9, /* ldr x2, [x2, #0] */
a06ea964 314 0x63, 0x00, 0x00, 0x91, /* add x3, x3, 0 */
caed7120
YZ		 315#else
316 0x42, 0x00, 0x40, 0xb9, /* ldr w2, [x2, #0] */
317 0x63, 0x00, 0x00, 0x11, /* add w3, w3, 0 */
318#endif
319 0x40, 0x00, 0x1f, 0xd6, /* br x2 */
a06ea964
NC		 320 0x1f, 0x20, 0x03, 0xd5, /* nop */
321 0x1f, 0x20, 0x03, 0xd5, /* nop */
322};
323
cec5225b
YZ		 324#define elf_info_to_howto elfNN_aarch64_info_to_howto
325#define elf_info_to_howto_rel elfNN_aarch64_info_to_howto
a06ea964
NC		 326
327#define AARCH64_ELF_ABI_VERSION 0
a06ea964
NC		 328
329/* In case we're on a 32-bit machine, construct a 64-bit "-1" value. */
330#define ALL_ONES (~ (bfd_vma) 0)
331
a6bb11b2
YZ		 332/* Indexed by the bfd interal reloc enumerators.
333 Therefore, the table needs to be synced with BFD_RELOC_AARCH64_*
334 in reloc.c. */
a06ea964 335
a6bb11b2 336static reloc_howto_type elfNN_aarch64_howto_table[] =
a06ea964 337{
a6bb11b2 338 EMPTY_HOWTO (0),
a06ea964 339
a6bb11b2 340 /* Basic data relocations. */
a06ea964 341
b7f28d87
JW		 342 /* Deprecated, but retained for backwards compatibility. */
343 HOWTO64 (R_AARCH64_NULL, /* type */
a06ea964 344 0, /* rightshift */
6346d5ca 345 3, /* size (0 = byte, 1 = short, 2 = long) */
a6bb11b2 346 0, /* bitsize */
a06ea964
NC		 347 FALSE, /* pc_relative */
348 0, /* bitpos */
349 complain_overflow_dont, /* complain_on_overflow */
350 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 351 "R_AARCH64_NULL", /* name */
a06ea964
NC		 352 FALSE, /* partial_inplace */
353 0, /* src_mask */
a6bb11b2 354 0, /* dst_mask */
a06ea964 355 FALSE), /* pcrel_offset */
a6bb11b2 356 HOWTO (R_AARCH64_NONE, /* type */
a06ea964 357 0, /* rightshift */
6346d5ca 358 3, /* size (0 = byte, 1 = short, 2 = long) */
a06ea964
NC		 359 0, /* bitsize */
360 FALSE, /* pc_relative */
361 0, /* bitpos */
362 complain_overflow_dont, /* complain_on_overflow */
363 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 364 "R_AARCH64_NONE", /* name */
a06ea964
NC		 365 FALSE, /* partial_inplace */
366 0, /* src_mask */
367 0, /* dst_mask */
368 FALSE), /* pcrel_offset */
369
370 /* .xword: (S+A) */
a6bb11b2 371 HOWTO64 (AARCH64_R (ABS64), /* type */
a06ea964
NC		 372 0, /* rightshift */
373 4, /* size (4 = long long) */
374 64, /* bitsize */
375 FALSE, /* pc_relative */
376 0, /* bitpos */
377 complain_overflow_unsigned, /* complain_on_overflow */
378 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 379 AARCH64_R_STR (ABS64), /* name */
a06ea964
NC		 380 FALSE, /* partial_inplace */
381 ALL_ONES, /* src_mask */
382 ALL_ONES, /* dst_mask */
383 FALSE), /* pcrel_offset */
384
385 /* .word: (S+A) */
a6bb11b2 386 HOWTO (AARCH64_R (ABS32), /* type */
a06ea964
NC		 387 0, /* rightshift */
388 2, /* size (0 = byte, 1 = short, 2 = long) */
389 32, /* bitsize */
390 FALSE, /* pc_relative */
391 0, /* bitpos */
392 complain_overflow_unsigned, /* complain_on_overflow */
393 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 394 AARCH64_R_STR (ABS32), /* name */
a06ea964
NC		 395 FALSE, /* partial_inplace */
396 0xffffffff, /* src_mask */
397 0xffffffff, /* dst_mask */
398 FALSE), /* pcrel_offset */
399
400 /* .half: (S+A) */
a6bb11b2 401 HOWTO (AARCH64_R (ABS16), /* type */
a06ea964
NC		 402 0, /* rightshift */
403 1, /* size (0 = byte, 1 = short, 2 = long) */
404 16, /* bitsize */
405 FALSE, /* pc_relative */
406 0, /* bitpos */
407 complain_overflow_unsigned, /* complain_on_overflow */
408 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 409 AARCH64_R_STR (ABS16), /* name */
a06ea964
NC		 410 FALSE, /* partial_inplace */
411 0xffff, /* src_mask */
412 0xffff, /* dst_mask */
413 FALSE), /* pcrel_offset */
414
415 /* .xword: (S+A-P) */
a6bb11b2 416 HOWTO64 (AARCH64_R (PREL64), /* type */
a06ea964
NC		 417 0, /* rightshift */
418 4, /* size (4 = long long) */
419 64, /* bitsize */
420 TRUE, /* pc_relative */
421 0, /* bitpos */
422 complain_overflow_signed, /* complain_on_overflow */
423 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 424 AARCH64_R_STR (PREL64), /* name */
a06ea964
NC		 425 FALSE, /* partial_inplace */
426 ALL_ONES, /* src_mask */
427 ALL_ONES, /* dst_mask */
428 TRUE), /* pcrel_offset */
429
430 /* .word: (S+A-P) */
a6bb11b2 431 HOWTO (AARCH64_R (PREL32), /* type */
a06ea964
NC		 432 0, /* rightshift */
433 2, /* size (0 = byte, 1 = short, 2 = long) */
434 32, /* bitsize */
435 TRUE, /* pc_relative */
436 0, /* bitpos */
437 complain_overflow_signed, /* complain_on_overflow */
438 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 439 AARCH64_R_STR (PREL32), /* name */
a06ea964
NC		 440 FALSE, /* partial_inplace */
441 0xffffffff, /* src_mask */
442 0xffffffff, /* dst_mask */
443 TRUE), /* pcrel_offset */
444
445 /* .half: (S+A-P) */
a6bb11b2 446 HOWTO (AARCH64_R (PREL16), /* type */
a06ea964
NC		 447 0, /* rightshift */
448 1, /* size (0 = byte, 1 = short, 2 = long) */
449 16, /* bitsize */
450 TRUE, /* pc_relative */
451 0, /* bitpos */
452 complain_overflow_signed, /* complain_on_overflow */
453 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 454 AARCH64_R_STR (PREL16), /* name */
a06ea964
NC		 455 FALSE, /* partial_inplace */
456 0xffff, /* src_mask */
457 0xffff, /* dst_mask */
458 TRUE), /* pcrel_offset */
459
460 /* Group relocations to create a 16, 32, 48 or 64 bit
461 unsigned data or abs address inline. */
462
463 /* MOVZ: ((S+A) >> 0) & 0xffff */
a6bb11b2 464 HOWTO (AARCH64_R (MOVW_UABS_G0), /* type */
a06ea964
NC		 465 0, /* rightshift */
466 2, /* size (0 = byte, 1 = short, 2 = long) */
467 16, /* bitsize */
468 FALSE, /* pc_relative */
469 0, /* bitpos */
470 complain_overflow_unsigned, /* complain_on_overflow */
471 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 472 AARCH64_R_STR (MOVW_UABS_G0), /* name */
a06ea964
NC		 473 FALSE, /* partial_inplace */
474 0xffff, /* src_mask */
475 0xffff, /* dst_mask */
476 FALSE), /* pcrel_offset */
477
478 /* MOVK: ((S+A) >> 0) & 0xffff [no overflow check] */
a6bb11b2 479 HOWTO (AARCH64_R (MOVW_UABS_G0_NC), /* type */
a06ea964
NC		 480 0, /* rightshift */
481 2, /* size (0 = byte, 1 = short, 2 = long) */
482 16, /* bitsize */
483 FALSE, /* pc_relative */
484 0, /* bitpos */
485 complain_overflow_dont, /* complain_on_overflow */
486 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 487 AARCH64_R_STR (MOVW_UABS_G0_NC), /* name */
a06ea964
NC		 488 FALSE, /* partial_inplace */
489 0xffff, /* src_mask */
490 0xffff, /* dst_mask */
491 FALSE), /* pcrel_offset */
492
493 /* MOVZ: ((S+A) >> 16) & 0xffff */
a6bb11b2 494 HOWTO (AARCH64_R (MOVW_UABS_G1), /* type */
a06ea964
NC		 495 16, /* rightshift */
496 2, /* size (0 = byte, 1 = short, 2 = long) */
497 16, /* bitsize */
498 FALSE, /* pc_relative */
499 0, /* bitpos */
500 complain_overflow_unsigned, /* complain_on_overflow */
501 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 502 AARCH64_R_STR (MOVW_UABS_G1), /* name */
a06ea964
NC		 503 FALSE, /* partial_inplace */
504 0xffff, /* src_mask */
505 0xffff, /* dst_mask */
506 FALSE), /* pcrel_offset */
507
508 /* MOVK: ((S+A) >> 16) & 0xffff [no overflow check] */
a6bb11b2 509 HOWTO64 (AARCH64_R (MOVW_UABS_G1_NC), /* type */
a06ea964
NC		 510 16, /* rightshift */
511 2, /* size (0 = byte, 1 = short, 2 = long) */
512 16, /* bitsize */
513 FALSE, /* pc_relative */
514 0, /* bitpos */
515 complain_overflow_dont, /* complain_on_overflow */
516 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 517 AARCH64_R_STR (MOVW_UABS_G1_NC), /* name */
a06ea964
NC		 518 FALSE, /* partial_inplace */
519 0xffff, /* src_mask */
520 0xffff, /* dst_mask */
521 FALSE), /* pcrel_offset */
522
523 /* MOVZ: ((S+A) >> 32) & 0xffff */
a6bb11b2 524 HOWTO64 (AARCH64_R (MOVW_UABS_G2), /* type */
a06ea964
NC		 525 32, /* rightshift */
526 2, /* size (0 = byte, 1 = short, 2 = long) */
527 16, /* bitsize */
528 FALSE, /* pc_relative */
529 0, /* bitpos */
530 complain_overflow_unsigned, /* complain_on_overflow */
531 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 532 AARCH64_R_STR (MOVW_UABS_G2), /* name */
a06ea964
NC		 533 FALSE, /* partial_inplace */
534 0xffff, /* src_mask */
535 0xffff, /* dst_mask */
536 FALSE), /* pcrel_offset */
537
538 /* MOVK: ((S+A) >> 32) & 0xffff [no overflow check] */
a6bb11b2 539 HOWTO64 (AARCH64_R (MOVW_UABS_G2_NC), /* type */
a06ea964
NC		 540 32, /* rightshift */
541 2, /* size (0 = byte, 1 = short, 2 = long) */
542 16, /* bitsize */
543 FALSE, /* pc_relative */
544 0, /* bitpos */
545 complain_overflow_dont, /* complain_on_overflow */
546 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 547 AARCH64_R_STR (MOVW_UABS_G2_NC), /* name */
a06ea964
NC		 548 FALSE, /* partial_inplace */
549 0xffff, /* src_mask */
550 0xffff, /* dst_mask */
551 FALSE), /* pcrel_offset */
552
553 /* MOVZ: ((S+A) >> 48) & 0xffff */
a6bb11b2 554 HOWTO64 (AARCH64_R (MOVW_UABS_G3), /* type */
a06ea964
NC		 555 48, /* rightshift */
556 2, /* size (0 = byte, 1 = short, 2 = long) */
557 16, /* bitsize */
558 FALSE, /* pc_relative */
559 0, /* bitpos */
560 complain_overflow_unsigned, /* complain_on_overflow */
561 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 562 AARCH64_R_STR (MOVW_UABS_G3), /* name */
a06ea964
NC		 563 FALSE, /* partial_inplace */
564 0xffff, /* src_mask */
565 0xffff, /* dst_mask */
566 FALSE), /* pcrel_offset */
567
568 /* Group relocations to create high part of a 16, 32, 48 or 64 bit
569 signed data or abs address inline. Will change instruction
570 to MOVN or MOVZ depending on sign of calculated value. */
571
572 /* MOV[ZN]: ((S+A) >> 0) & 0xffff */
a6bb11b2 573 HOWTO (AARCH64_R (MOVW_SABS_G0), /* type */
a06ea964
NC		 574 0, /* rightshift */
575 2, /* size (0 = byte, 1 = short, 2 = long) */
c5e3a364 576 17, /* bitsize */
a06ea964
NC		 577 FALSE, /* pc_relative */
578 0, /* bitpos */
579 complain_overflow_signed, /* complain_on_overflow */
580 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 581 AARCH64_R_STR (MOVW_SABS_G0), /* name */
a06ea964
NC		 582 FALSE, /* partial_inplace */
583 0xffff, /* src_mask */
584 0xffff, /* dst_mask */
585 FALSE), /* pcrel_offset */
586
587 /* MOV[ZN]: ((S+A) >> 16) & 0xffff */
a6bb11b2 588 HOWTO64 (AARCH64_R (MOVW_SABS_G1), /* type */
a06ea964
NC		 589 16, /* rightshift */
590 2, /* size (0 = byte, 1 = short, 2 = long) */
c5e3a364 591 17, /* bitsize */
a06ea964
NC		 592 FALSE, /* pc_relative */
593 0, /* bitpos */
594 complain_overflow_signed, /* complain_on_overflow */
595 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 596 AARCH64_R_STR (MOVW_SABS_G1), /* name */
a06ea964
NC		 597 FALSE, /* partial_inplace */
598 0xffff, /* src_mask */
599 0xffff, /* dst_mask */
600 FALSE), /* pcrel_offset */
601
602 /* MOV[ZN]: ((S+A) >> 32) & 0xffff */
a6bb11b2 603 HOWTO64 (AARCH64_R (MOVW_SABS_G2), /* type */
a06ea964
NC		 604 32, /* rightshift */
605 2, /* size (0 = byte, 1 = short, 2 = long) */
c5e3a364 606 17, /* bitsize */
a06ea964
NC		 607 FALSE, /* pc_relative */
608 0, /* bitpos */
609 complain_overflow_signed, /* complain_on_overflow */
610 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 611 AARCH64_R_STR (MOVW_SABS_G2), /* name */
a06ea964
NC		 612 FALSE, /* partial_inplace */
613 0xffff, /* src_mask */
614 0xffff, /* dst_mask */
615 FALSE), /* pcrel_offset */
616
617/* Relocations to generate 19, 21 and 33 bit PC-relative load/store
618 addresses: PG(x) is (x & ~0xfff). */
619
620 /* LD-lit: ((S+A-P) >> 2) & 0x7ffff */
a6bb11b2 621 HOWTO (AARCH64_R (LD_PREL_LO19), /* type */
a06ea964
NC		 622 2, /* rightshift */
623 2, /* size (0 = byte, 1 = short, 2 = long) */
624 19, /* bitsize */
625 TRUE, /* pc_relative */
626 0, /* bitpos */
627 complain_overflow_signed, /* complain_on_overflow */
628 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 629 AARCH64_R_STR (LD_PREL_LO19), /* name */
a06ea964
NC		 630 FALSE, /* partial_inplace */
631 0x7ffff, /* src_mask */
632 0x7ffff, /* dst_mask */
633 TRUE), /* pcrel_offset */
634
635 /* ADR: (S+A-P) & 0x1fffff */
a6bb11b2 636 HOWTO (AARCH64_R (ADR_PREL_LO21), /* type */
a06ea964
NC		 637 0, /* rightshift */
638 2, /* size (0 = byte, 1 = short, 2 = long) */
639 21, /* bitsize */
640 TRUE, /* pc_relative */
641 0, /* bitpos */
642 complain_overflow_signed, /* complain_on_overflow */
643 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 644 AARCH64_R_STR (ADR_PREL_LO21), /* name */
a06ea964
NC		 645 FALSE, /* partial_inplace */
646 0x1fffff, /* src_mask */
647 0x1fffff, /* dst_mask */
648 TRUE), /* pcrel_offset */
649
650 /* ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
a6bb11b2 651 HOWTO (AARCH64_R (ADR_PREL_PG_HI21), /* type */
a06ea964
NC		 652 12, /* rightshift */
653 2, /* size (0 = byte, 1 = short, 2 = long) */
654 21, /* bitsize */
655 TRUE, /* pc_relative */
656 0, /* bitpos */
657 complain_overflow_signed, /* complain_on_overflow */
658 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 659 AARCH64_R_STR (ADR_PREL_PG_HI21), /* name */
a06ea964
NC		 660 FALSE, /* partial_inplace */
661 0x1fffff, /* src_mask */
662 0x1fffff, /* dst_mask */
663 TRUE), /* pcrel_offset */
664
665 /* ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff [no overflow check] */
a6bb11b2 666 HOWTO64 (AARCH64_R (ADR_PREL_PG_HI21_NC), /* type */
a06ea964
NC		 667 12, /* rightshift */
668 2, /* size (0 = byte, 1 = short, 2 = long) */
669 21, /* bitsize */
670 TRUE, /* pc_relative */
671 0, /* bitpos */
672 complain_overflow_dont, /* complain_on_overflow */
673 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 674 AARCH64_R_STR (ADR_PREL_PG_HI21_NC), /* name */
a06ea964
NC		 675 FALSE, /* partial_inplace */
676 0x1fffff, /* src_mask */
677 0x1fffff, /* dst_mask */
678 TRUE), /* pcrel_offset */
679
680 /* ADD: (S+A) & 0xfff [no overflow check] */
a6bb11b2 681 HOWTO (AARCH64_R (ADD_ABS_LO12_NC), /* type */
a06ea964
NC		 682 0, /* rightshift */
683 2, /* size (0 = byte, 1 = short, 2 = long) */
684 12, /* bitsize */
685 FALSE, /* pc_relative */
686 10, /* bitpos */
687 complain_overflow_dont, /* complain_on_overflow */
688 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 689 AARCH64_R_STR (ADD_ABS_LO12_NC), /* name */
a06ea964
NC		 690 FALSE, /* partial_inplace */
691 0x3ffc00, /* src_mask */
692 0x3ffc00, /* dst_mask */
693 FALSE), /* pcrel_offset */
694
695 /* LD/ST8: (S+A) & 0xfff */
a6bb11b2 696 HOWTO (AARCH64_R (LDST8_ABS_LO12_NC), /* type */
a06ea964
NC		 697 0, /* rightshift */
698 2, /* size (0 = byte, 1 = short, 2 = long) */
699 12, /* bitsize */
700 FALSE, /* pc_relative */
701 0, /* bitpos */
702 complain_overflow_dont, /* complain_on_overflow */
703 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 704 AARCH64_R_STR (LDST8_ABS_LO12_NC), /* name */
a06ea964
NC		 705 FALSE, /* partial_inplace */
706 0xfff, /* src_mask */
707 0xfff, /* dst_mask */
708 FALSE), /* pcrel_offset */
709
710 /* Relocations for control-flow instructions. */
711
712 /* TBZ/NZ: ((S+A-P) >> 2) & 0x3fff */
a6bb11b2 713 HOWTO (AARCH64_R (TSTBR14), /* type */
a06ea964
NC		 714 2, /* rightshift */
715 2, /* size (0 = byte, 1 = short, 2 = long) */
716 14, /* bitsize */
717 TRUE, /* pc_relative */
718 0, /* bitpos */
719 complain_overflow_signed, /* complain_on_overflow */
720 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 721 AARCH64_R_STR (TSTBR14), /* name */
a06ea964
NC		 722 FALSE, /* partial_inplace */
723 0x3fff, /* src_mask */
724 0x3fff, /* dst_mask */
725 TRUE), /* pcrel_offset */
726
727 /* B.cond: ((S+A-P) >> 2) & 0x7ffff */
a6bb11b2 728 HOWTO (AARCH64_R (CONDBR19), /* type */
a06ea964
NC		 729 2, /* rightshift */
730 2, /* size (0 = byte, 1 = short, 2 = long) */
731 19, /* bitsize */
732 TRUE, /* pc_relative */
733 0, /* bitpos */
734 complain_overflow_signed, /* complain_on_overflow */
735 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 736 AARCH64_R_STR (CONDBR19), /* name */
a06ea964
NC		 737 FALSE, /* partial_inplace */
738 0x7ffff, /* src_mask */
739 0x7ffff, /* dst_mask */
740 TRUE), /* pcrel_offset */
741
a06ea964 742 /* B: ((S+A-P) >> 2) & 0x3ffffff */
a6bb11b2 743 HOWTO (AARCH64_R (JUMP26), /* type */
a06ea964
NC		 744 2, /* rightshift */
745 2, /* size (0 = byte, 1 = short, 2 = long) */
746 26, /* bitsize */
747 TRUE, /* pc_relative */
748 0, /* bitpos */
749 complain_overflow_signed, /* complain_on_overflow */
750 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 751 AARCH64_R_STR (JUMP26), /* name */
a06ea964
NC		 752 FALSE, /* partial_inplace */
753 0x3ffffff, /* src_mask */
754 0x3ffffff, /* dst_mask */
755 TRUE), /* pcrel_offset */
756
757 /* BL: ((S+A-P) >> 2) & 0x3ffffff */
a6bb11b2 758 HOWTO (AARCH64_R (CALL26), /* type */
a06ea964
NC		 759 2, /* rightshift */
760 2, /* size (0 = byte, 1 = short, 2 = long) */
761 26, /* bitsize */
762 TRUE, /* pc_relative */
763 0, /* bitpos */
764 complain_overflow_signed, /* complain_on_overflow */
765 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 766 AARCH64_R_STR (CALL26), /* name */
a06ea964
NC		 767 FALSE, /* partial_inplace */
768 0x3ffffff, /* src_mask */
769 0x3ffffff, /* dst_mask */
770 TRUE), /* pcrel_offset */
771
772 /* LD/ST16: (S+A) & 0xffe */
a6bb11b2 773 HOWTO (AARCH64_R (LDST16_ABS_LO12_NC), /* type */
a06ea964
NC		 774 1, /* rightshift */
775 2, /* size (0 = byte, 1 = short, 2 = long) */
776 12, /* bitsize */
777 FALSE, /* pc_relative */
778 0, /* bitpos */
779 complain_overflow_dont, /* complain_on_overflow */
780 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 781 AARCH64_R_STR (LDST16_ABS_LO12_NC), /* name */
a06ea964
NC		 782 FALSE, /* partial_inplace */
783 0xffe, /* src_mask */
784 0xffe, /* dst_mask */
785 FALSE), /* pcrel_offset */
786
787 /* LD/ST32: (S+A) & 0xffc */
a6bb11b2 788 HOWTO (AARCH64_R (LDST32_ABS_LO12_NC), /* type */
a06ea964
NC		 789 2, /* rightshift */
790 2, /* size (0 = byte, 1 = short, 2 = long) */
791 12, /* bitsize */
792 FALSE, /* pc_relative */
793 0, /* bitpos */
794 complain_overflow_dont, /* complain_on_overflow */
795 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 796 AARCH64_R_STR (LDST32_ABS_LO12_NC), /* name */
a06ea964
NC		 797 FALSE, /* partial_inplace */
798 0xffc, /* src_mask */
799 0xffc, /* dst_mask */
800 FALSE), /* pcrel_offset */
801
802 /* LD/ST64: (S+A) & 0xff8 */
a6bb11b2 803 HOWTO (AARCH64_R (LDST64_ABS_LO12_NC), /* type */
a06ea964
NC		 804 3, /* rightshift */
805 2, /* size (0 = byte, 1 = short, 2 = long) */
806 12, /* bitsize */
807 FALSE, /* pc_relative */
808 0, /* bitpos */
809 complain_overflow_dont, /* complain_on_overflow */
810 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 811 AARCH64_R_STR (LDST64_ABS_LO12_NC), /* name */
a06ea964
NC		 812 FALSE, /* partial_inplace */
813 0xff8, /* src_mask */
814 0xff8, /* dst_mask */
815 FALSE), /* pcrel_offset */
816
a06ea964 817 /* LD/ST128: (S+A) & 0xff0 */
a6bb11b2 818 HOWTO (AARCH64_R (LDST128_ABS_LO12_NC), /* type */
a06ea964
NC		 819 4, /* rightshift */
820 2, /* size (0 = byte, 1 = short, 2 = long) */
821 12, /* bitsize */
822 FALSE, /* pc_relative */
823 0, /* bitpos */
824 complain_overflow_dont, /* complain_on_overflow */
825 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 826 AARCH64_R_STR (LDST128_ABS_LO12_NC), /* name */
a06ea964
NC		 827 FALSE, /* partial_inplace */
828 0xff0, /* src_mask */
829 0xff0, /* dst_mask */
830 FALSE), /* pcrel_offset */
831
f41aef5f
RE		 832 /* Set a load-literal immediate field to bits
833 0x1FFFFC of G(S)-P */
a6bb11b2 834 HOWTO (AARCH64_R (GOT_LD_PREL19), /* type */
f41aef5f
RE		 835 2, /* rightshift */
836 2, /* size (0 = byte,1 = short,2 = long) */
837 19, /* bitsize */
838 TRUE, /* pc_relative */
839 0, /* bitpos */
840 complain_overflow_signed, /* complain_on_overflow */
841 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 842 AARCH64_R_STR (GOT_LD_PREL19), /* name */
f41aef5f
RE		 843 FALSE, /* partial_inplace */
844 0xffffe0, /* src_mask */
845 0xffffe0, /* dst_mask */
846 TRUE), /* pcrel_offset */
847
a06ea964
NC		 848 /* Get to the page for the GOT entry for the symbol
849 (G(S) - P) using an ADRP instruction. */
a6bb11b2 850 HOWTO (AARCH64_R (ADR_GOT_PAGE), /* type */
a06ea964
NC		 851 12, /* rightshift */
852 2, /* size (0 = byte, 1 = short, 2 = long) */
853 21, /* bitsize */
854 TRUE, /* pc_relative */
855 0, /* bitpos */
856 complain_overflow_dont, /* complain_on_overflow */
857 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 858 AARCH64_R_STR (ADR_GOT_PAGE), /* name */
a06ea964
NC		 859 FALSE, /* partial_inplace */
860 0x1fffff, /* src_mask */
861 0x1fffff, /* dst_mask */
862 TRUE), /* pcrel_offset */
863
a6bb11b2
YZ		 864 /* LD64: GOT offset G(S) & 0xff8 */
865 HOWTO64 (AARCH64_R (LD64_GOT_LO12_NC), /* type */
a06ea964
NC		 866 3, /* rightshift */
867 2, /* size (0 = byte, 1 = short, 2 = long) */
868 12, /* bitsize */
869 FALSE, /* pc_relative */
870 0, /* bitpos */
871 complain_overflow_dont, /* complain_on_overflow */
872 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 873 AARCH64_R_STR (LD64_GOT_LO12_NC), /* name */
a06ea964
NC		 874 FALSE, /* partial_inplace */
875 0xff8, /* src_mask */
876 0xff8, /* dst_mask */
a6bb11b2 877 FALSE), /* pcrel_offset */
a06ea964 878
a6bb11b2
YZ		 879 /* LD32: GOT offset G(S) & 0xffc */
880 HOWTO32 (AARCH64_R (LD32_GOT_LO12_NC), /* type */
881 2, /* rightshift */
882 2, /* size (0 = byte, 1 = short, 2 = long) */
883 12, /* bitsize */
884 FALSE, /* pc_relative */
885 0, /* bitpos */
886 complain_overflow_dont, /* complain_on_overflow */
887 bfd_elf_generic_reloc, /* special_function */
888 AARCH64_R_STR (LD32_GOT_LO12_NC), /* name */
889 FALSE, /* partial_inplace */
890 0xffc, /* src_mask */
891 0xffc, /* dst_mask */
892 FALSE), /* pcrel_offset */
a06ea964 893
ca632371
RL		 894 /* Lower 16 bits of GOT offset for the symbol. */
895 HOWTO64 (AARCH64_R (MOVW_GOTOFF_G0_NC), /* type */
896 0, /* rightshift */
897 2, /* size (0 = byte, 1 = short, 2 = long) */
898 16, /* bitsize */
899 FALSE, /* pc_relative */
900 0, /* bitpos */
901 complain_overflow_dont, /* complain_on_overflow */
902 bfd_elf_generic_reloc, /* special_function */
903 AARCH64_R_STR (MOVW_GOTOFF_G0_NC), /* name */
904 FALSE, /* partial_inplace */
905 0xffff, /* src_mask */
906 0xffff, /* dst_mask */
907 FALSE), /* pcrel_offset */
908
654248e7
RL		 909 /* Higher 16 bits of GOT offset for the symbol. */
910 HOWTO64 (AARCH64_R (MOVW_GOTOFF_G1), /* type */
911 16, /* rightshift */
912 2, /* size (0 = byte, 1 = short, 2 = long) */
913 16, /* bitsize */
914 FALSE, /* pc_relative */
915 0, /* bitpos */
916 complain_overflow_unsigned, /* complain_on_overflow */
917 bfd_elf_generic_reloc, /* special_function */
918 AARCH64_R_STR (MOVW_GOTOFF_G1), /* name */
919 FALSE, /* partial_inplace */
920 0xffff, /* src_mask */
921 0xffff, /* dst_mask */
922 FALSE), /* pcrel_offset */
923
87f5fbcc
RL		 924 /* LD64: GOT offset for the symbol. */
925 HOWTO64 (AARCH64_R (LD64_GOTOFF_LO15), /* type */
926 3, /* rightshift */
927 2, /* size (0 = byte, 1 = short, 2 = long) */
928 12, /* bitsize */
929 FALSE, /* pc_relative */
930 0, /* bitpos */
931 complain_overflow_unsigned, /* complain_on_overflow */
932 bfd_elf_generic_reloc, /* special_function */
933 AARCH64_R_STR (LD64_GOTOFF_LO15), /* name */
934 FALSE, /* partial_inplace */
935 0x7ff8, /* src_mask */
936 0x7ff8, /* dst_mask */
937 FALSE), /* pcrel_offset */
938
3d715ce4
JW		 939 /* LD32: GOT offset to the page address of GOT table.
940 (G(S) - PAGE (_GLOBAL_OFFSET_TABLE_)) & 0x5ffc. */
941 HOWTO32 (AARCH64_R (LD32_GOTPAGE_LO14), /* type */
942 2, /* rightshift */
943 2, /* size (0 = byte, 1 = short, 2 = long) */
944 12, /* bitsize */
945 FALSE, /* pc_relative */
946 0, /* bitpos */
947 complain_overflow_unsigned, /* complain_on_overflow */
948 bfd_elf_generic_reloc, /* special_function */
949 AARCH64_R_STR (LD32_GOTPAGE_LO14), /* name */
950 FALSE, /* partial_inplace */
951 0x5ffc, /* src_mask */
952 0x5ffc, /* dst_mask */
953 FALSE), /* pcrel_offset */
954
a921b5bd
JW		 955 /* LD64: GOT offset to the page address of GOT table.
956 (G(S) - PAGE (_GLOBAL_OFFSET_TABLE_)) & 0x7ff8. */
957 HOWTO64 (AARCH64_R (LD64_GOTPAGE_LO15), /* type */
958 3, /* rightshift */
959 2, /* size (0 = byte, 1 = short, 2 = long) */
960 12, /* bitsize */
961 FALSE, /* pc_relative */
962 0, /* bitpos */
963 complain_overflow_unsigned, /* complain_on_overflow */
964 bfd_elf_generic_reloc, /* special_function */
965 AARCH64_R_STR (LD64_GOTPAGE_LO15), /* name */
966 FALSE, /* partial_inplace */
967 0x7ff8, /* src_mask */
968 0x7ff8, /* dst_mask */
969 FALSE), /* pcrel_offset */
970
a06ea964
NC		 971 /* Get to the page for the GOT entry for the symbol
972 (G(S) - P) using an ADRP instruction. */
a6bb11b2 973 HOWTO (AARCH64_R (TLSGD_ADR_PAGE21), /* type */
a06ea964
NC		 974 12, /* rightshift */
975 2, /* size (0 = byte, 1 = short, 2 = long) */
976 21, /* bitsize */
977 TRUE, /* pc_relative */
978 0, /* bitpos */
979 complain_overflow_dont, /* complain_on_overflow */
980 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 981 AARCH64_R_STR (TLSGD_ADR_PAGE21), /* name */
a06ea964
NC		 982 FALSE, /* partial_inplace */
983 0x1fffff, /* src_mask */
984 0x1fffff, /* dst_mask */
985 TRUE), /* pcrel_offset */
986
3c12b054
MS		 987 HOWTO (AARCH64_R (TLSGD_ADR_PREL21), /* type */
988 0, /* rightshift */
989 2, /* size (0 = byte, 1 = short, 2 = long) */
990 21, /* bitsize */
991 TRUE, /* pc_relative */
992 0, /* bitpos */
993 complain_overflow_dont, /* complain_on_overflow */
994 bfd_elf_generic_reloc, /* special_function */
995 AARCH64_R_STR (TLSGD_ADR_PREL21), /* name */
996 FALSE, /* partial_inplace */
997 0x1fffff, /* src_mask */
998 0x1fffff, /* dst_mask */
999 TRUE), /* pcrel_offset */
1000
a06ea964 1001 /* ADD: GOT offset G(S) & 0xff8 [no overflow check] */
a6bb11b2 1002 HOWTO (AARCH64_R (TLSGD_ADD_LO12_NC), /* type */
a06ea964
NC		 1003 0, /* rightshift */
1004 2, /* size (0 = byte, 1 = short, 2 = long) */
1005 12, /* bitsize */
1006 FALSE, /* pc_relative */
1007 0, /* bitpos */
1008 complain_overflow_dont, /* complain_on_overflow */
1009 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1010 AARCH64_R_STR (TLSGD_ADD_LO12_NC), /* name */
a06ea964
NC		 1011 FALSE, /* partial_inplace */
1012 0xfff, /* src_mask */
1013 0xfff, /* dst_mask */
1014 FALSE), /* pcrel_offset */
1015
3e8286c0
RL		 1016 /* Lower 16 bits of GOT offset to tls_index. */
1017 HOWTO64 (AARCH64_R (TLSGD_MOVW_G0_NC), /* type */
1018 0, /* rightshift */
1019 2, /* size (0 = byte, 1 = short, 2 = long) */
1020 16, /* bitsize */
1021 FALSE, /* pc_relative */
1022 0, /* bitpos */
1023 complain_overflow_dont, /* complain_on_overflow */
1024 bfd_elf_generic_reloc, /* special_function */
1025 AARCH64_R_STR (TLSGD_MOVW_G0_NC), /* name */
1026 FALSE, /* partial_inplace */
1027 0xffff, /* src_mask */
1028 0xffff, /* dst_mask */
1029 FALSE), /* pcrel_offset */
1030
1aa66fb1
RL		 1031 /* Higher 16 bits of GOT offset to tls_index. */
1032 HOWTO64 (AARCH64_R (TLSGD_MOVW_G1), /* type */
1033 16, /* rightshift */
1034 2, /* size (0 = byte, 1 = short, 2 = long) */
1035 16, /* bitsize */
1036 FALSE, /* pc_relative */
1037 0, /* bitpos */
1038 complain_overflow_unsigned, /* complain_on_overflow */
1039 bfd_elf_generic_reloc, /* special_function */
1040 AARCH64_R_STR (TLSGD_MOVW_G1), /* name */
1041 FALSE, /* partial_inplace */
1042 0xffff, /* src_mask */
1043 0xffff, /* dst_mask */
1044 FALSE), /* pcrel_offset */
1045
a6bb11b2 1046 HOWTO (AARCH64_R (TLSIE_ADR_GOTTPREL_PAGE21), /* type */
a06ea964
NC		 1047 12, /* rightshift */
1048 2, /* size (0 = byte, 1 = short, 2 = long) */
1049 21, /* bitsize */
1050 FALSE, /* pc_relative */
1051 0, /* bitpos */
1052 complain_overflow_dont, /* complain_on_overflow */
1053 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1054 AARCH64_R_STR (TLSIE_ADR_GOTTPREL_PAGE21), /* name */
a06ea964
NC		 1055 FALSE, /* partial_inplace */
1056 0x1fffff, /* src_mask */
1057 0x1fffff, /* dst_mask */
1058 FALSE), /* pcrel_offset */
1059
a6bb11b2 1060 HOWTO64 (AARCH64_R (TLSIE_LD64_GOTTPREL_LO12_NC), /* type */
a06ea964
NC		 1061 3, /* rightshift */
1062 2, /* size (0 = byte, 1 = short, 2 = long) */
1063 12, /* bitsize */
1064 FALSE, /* pc_relative */
1065 0, /* bitpos */
1066 complain_overflow_dont, /* complain_on_overflow */
1067 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1068 AARCH64_R_STR (TLSIE_LD64_GOTTPREL_LO12_NC), /* name */
a06ea964
NC		 1069 FALSE, /* partial_inplace */
1070 0xff8, /* src_mask */
1071 0xff8, /* dst_mask */
1072 FALSE), /* pcrel_offset */
1073
a6bb11b2
YZ		 1074 HOWTO32 (AARCH64_R (TLSIE_LD32_GOTTPREL_LO12_NC), /* type */
1075 2, /* rightshift */
1076 2, /* size (0 = byte, 1 = short, 2 = long) */
1077 12, /* bitsize */
1078 FALSE, /* pc_relative */
1079 0, /* bitpos */
1080 complain_overflow_dont, /* complain_on_overflow */
1081 bfd_elf_generic_reloc, /* special_function */
1082 AARCH64_R_STR (TLSIE_LD32_GOTTPREL_LO12_NC), /* name */
1083 FALSE, /* partial_inplace */
1084 0xffc, /* src_mask */
1085 0xffc, /* dst_mask */
1086 FALSE), /* pcrel_offset */
1087
1088 HOWTO (AARCH64_R (TLSIE_LD_GOTTPREL_PREL19), /* type */
bb3f9ed8 1089 2, /* rightshift */
a06ea964 1090 2, /* size (0 = byte, 1 = short, 2 = long) */
043bf05a 1091 19, /* bitsize */
a06ea964
NC		 1092 FALSE, /* pc_relative */
1093 0, /* bitpos */
1094 complain_overflow_dont, /* complain_on_overflow */
1095 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1096 AARCH64_R_STR (TLSIE_LD_GOTTPREL_PREL19), /* name */
a06ea964
NC		 1097 FALSE, /* partial_inplace */
1098 0x1ffffc, /* src_mask */
1099 0x1ffffc, /* dst_mask */
1100 FALSE), /* pcrel_offset */
1101
3b957e5b
RL		 1102 HOWTO64 (AARCH64_R (TLSIE_MOVW_GOTTPREL_G0_NC), /* type */
1103 0, /* rightshift */
1104 2, /* size (0 = byte, 1 = short, 2 = long) */
1105 16, /* bitsize */
1106 FALSE, /* pc_relative */
1107 0, /* bitpos */
1108 complain_overflow_dont, /* complain_on_overflow */
1109 bfd_elf_generic_reloc, /* special_function */
1110 AARCH64_R_STR (TLSIE_MOVW_GOTTPREL_G0_NC), /* name */
1111 FALSE, /* partial_inplace */
1112 0xffff, /* src_mask */
1113 0xffff, /* dst_mask */
1114 FALSE), /* pcrel_offset */
1115
1116 HOWTO64 (AARCH64_R (TLSIE_MOVW_GOTTPREL_G1), /* type */
1117 16, /* rightshift */
1118 2, /* size (0 = byte, 1 = short, 2 = long) */
1119 16, /* bitsize */
1120 FALSE, /* pc_relative */
1121 0, /* bitpos */
1122 complain_overflow_unsigned, /* complain_on_overflow */
1123 bfd_elf_generic_reloc, /* special_function */
1124 AARCH64_R_STR (TLSIE_MOVW_GOTTPREL_G1), /* name */
1125 FALSE, /* partial_inplace */
1126 0xffff, /* src_mask */
1127 0xffff, /* dst_mask */
1128 FALSE), /* pcrel_offset */
1129
49df5539
JW		 1130 /* ADD: bit[23:12] of byte offset to module TLS base address. */
1131 HOWTO (AARCH64_R (TLSLD_ADD_DTPREL_HI12), /* type */
1132 12, /* rightshift */
1133 2, /* size (0 = byte, 1 = short, 2 = long) */
1134 12, /* bitsize */
1135 FALSE, /* pc_relative */
1136 0, /* bitpos */
1137 complain_overflow_unsigned, /* complain_on_overflow */
1138 bfd_elf_generic_reloc, /* special_function */
1139 AARCH64_R_STR (TLSLD_ADD_DTPREL_HI12), /* name */
1140 FALSE, /* partial_inplace */
1141 0xfff, /* src_mask */
1142 0xfff, /* dst_mask */
1143 FALSE), /* pcrel_offset */
1144
70151fb5
JW		 1145 /* Unsigned 12 bit byte offset to module TLS base address. */
1146 HOWTO (AARCH64_R (TLSLD_ADD_DTPREL_LO12), /* type */
1147 0, /* rightshift */
1148 2, /* size (0 = byte, 1 = short, 2 = long) */
1149 12, /* bitsize */
1150 FALSE, /* pc_relative */
1151 0, /* bitpos */
1152 complain_overflow_unsigned, /* complain_on_overflow */
1153 bfd_elf_generic_reloc, /* special_function */
1154 AARCH64_R_STR (TLSLD_ADD_DTPREL_LO12), /* name */
1155 FALSE, /* partial_inplace */
1156 0xfff, /* src_mask */
1157 0xfff, /* dst_mask */
1158 FALSE), /* pcrel_offset */
13289c10
JW		 1159
1160 /* No overflow check version of BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12. */
1161 HOWTO (AARCH64_R (TLSLD_ADD_DTPREL_LO12_NC), /* type */
1162 0, /* rightshift */
1163 2, /* size (0 = byte, 1 = short, 2 = long) */
1164 12, /* bitsize */
1165 FALSE, /* pc_relative */
1166 0, /* bitpos */
1167 complain_overflow_dont, /* complain_on_overflow */
1168 bfd_elf_generic_reloc, /* special_function */
1169 AARCH64_R_STR (TLSLD_ADD_DTPREL_LO12_NC), /* name */
1170 FALSE, /* partial_inplace */
1171 0xfff, /* src_mask */
1172 0xfff, /* dst_mask */
1173 FALSE), /* pcrel_offset */
70151fb5 1174
a12fad50
JW		 1175 /* ADD: GOT offset G(S) & 0xff8 [no overflow check] */
1176 HOWTO (AARCH64_R (TLSLD_ADD_LO12_NC), /* type */
1177 0, /* rightshift */
1178 2, /* size (0 = byte, 1 = short, 2 = long) */
1179 12, /* bitsize */
1180 FALSE, /* pc_relative */
1181 0, /* bitpos */
1182 complain_overflow_dont, /* complain_on_overflow */
1183 bfd_elf_generic_reloc, /* special_function */
1184 AARCH64_R_STR (TLSLD_ADD_LO12_NC), /* name */
1185 FALSE, /* partial_inplace */
1186 0xfff, /* src_mask */
1187 0xfff, /* dst_mask */
1188 FALSE), /* pcrel_offset */
1189
1107e076
JW		 1190 /* Get to the page for the GOT entry for the symbol
1191 (G(S) - P) using an ADRP instruction. */
1192 HOWTO (AARCH64_R (TLSLD_ADR_PAGE21), /* type */
1193 12, /* rightshift */
1194 2, /* size (0 = byte, 1 = short, 2 = long) */
1195 21, /* bitsize */
1196 TRUE, /* pc_relative */
1197 0, /* bitpos */
1198 complain_overflow_signed, /* complain_on_overflow */
1199 bfd_elf_generic_reloc, /* special_function */
1200 AARCH64_R_STR (TLSLD_ADR_PAGE21), /* name */
1201 FALSE, /* partial_inplace */
1202 0x1fffff, /* src_mask */
1203 0x1fffff, /* dst_mask */
1204 TRUE), /* pcrel_offset */
1205
6c37fedc
JW		 1206 HOWTO (AARCH64_R (TLSLD_ADR_PREL21), /* type */
1207 0, /* rightshift */
1208 2, /* size (0 = byte, 1 = short, 2 = long) */
1209 21, /* bitsize */
1210 TRUE, /* pc_relative */
1211 0, /* bitpos */
1212 complain_overflow_signed, /* complain_on_overflow */
1213 bfd_elf_generic_reloc, /* special_function */
1214 AARCH64_R_STR (TLSLD_ADR_PREL21), /* name */
1215 FALSE, /* partial_inplace */
1216 0x1fffff, /* src_mask */
1217 0x1fffff, /* dst_mask */
1218 TRUE), /* pcrel_offset */
1219
4c562523
JW		 1220 /* LD/ST16: bit[11:1] of byte offset to module TLS base address. */
1221 HOWTO64 (AARCH64_R (TLSLD_LDST16_DTPREL_LO12), /* type */
1222 1, /* rightshift */
1223 2, /* size (0 = byte, 1 = short, 2 = long) */
1224 11, /* bitsize */
1225 FALSE, /* pc_relative */
1226 10, /* bitpos */
1227 complain_overflow_unsigned, /* complain_on_overflow */
1228 bfd_elf_generic_reloc, /* special_function */
1229 AARCH64_R_STR (TLSLD_LDST16_DTPREL_LO12), /* name */
1230 FALSE, /* partial_inplace */
1231 0x1ffc00, /* src_mask */
1232 0x1ffc00, /* dst_mask */
1233 FALSE), /* pcrel_offset */
1234
1235 /* Same as BFD_RELOC_AARCH64_TLSLD_LDST16_DTPREL_LO12, but no overflow check. */
1236 HOWTO64 (AARCH64_R (TLSLD_LDST16_DTPREL_LO12_NC), /* type */
1237 1, /* rightshift */
1238 2, /* size (0 = byte, 1 = short, 2 = long) */
1239 11, /* bitsize */
1240 FALSE, /* pc_relative */
1241 10, /* bitpos */
1242 complain_overflow_dont, /* complain_on_overflow */
1243 bfd_elf_generic_reloc, /* special_function */
1244 AARCH64_R_STR (TLSLD_LDST16_DTPREL_LO12_NC), /* name */
1245 FALSE, /* partial_inplace */
1246 0x1ffc00, /* src_mask */
1247 0x1ffc00, /* dst_mask */
1248 FALSE), /* pcrel_offset */
1249
1250 /* LD/ST32: bit[11:2] of byte offset to module TLS base address. */
1251 HOWTO64 (AARCH64_R (TLSLD_LDST32_DTPREL_LO12), /* type */
1252 2, /* rightshift */
1253 2, /* size (0 = byte, 1 = short, 2 = long) */
1254 10, /* bitsize */
1255 FALSE, /* pc_relative */
1256 10, /* bitpos */
1257 complain_overflow_unsigned, /* complain_on_overflow */
1258 bfd_elf_generic_reloc, /* special_function */
1259 AARCH64_R_STR (TLSLD_LDST32_DTPREL_LO12), /* name */
1260 FALSE, /* partial_inplace */
1261 0x3ffc00, /* src_mask */
1262 0x3ffc00, /* dst_mask */
1263 FALSE), /* pcrel_offset */
1264
1265 /* Same as BFD_RELOC_AARCH64_TLSLD_LDST32_DTPREL_LO12, but no overflow check. */
1266 HOWTO64 (AARCH64_R (TLSLD_LDST32_DTPREL_LO12_NC), /* type */
1267 2, /* rightshift */
1268 2, /* size (0 = byte, 1 = short, 2 = long) */
1269 10, /* bitsize */
1270 FALSE, /* pc_relative */
1271 10, /* bitpos */
1272 complain_overflow_dont, /* complain_on_overflow */
1273 bfd_elf_generic_reloc, /* special_function */
1274 AARCH64_R_STR (TLSLD_LDST32_DTPREL_LO12_NC), /* name */
1275 FALSE, /* partial_inplace */
1276 0xffc00, /* src_mask */
1277 0xffc00, /* dst_mask */
1278 FALSE), /* pcrel_offset */
1279
1280 /* LD/ST64: bit[11:3] of byte offset to module TLS base address. */
1281 HOWTO64 (AARCH64_R (TLSLD_LDST64_DTPREL_LO12), /* type */
1282 3, /* rightshift */
1283 2, /* size (0 = byte, 1 = short, 2 = long) */
1284 9, /* bitsize */
1285 FALSE, /* pc_relative */
1286 10, /* bitpos */
1287 complain_overflow_unsigned, /* complain_on_overflow */
1288 bfd_elf_generic_reloc, /* special_function */
1289 AARCH64_R_STR (TLSLD_LDST64_DTPREL_LO12), /* name */
1290 FALSE, /* partial_inplace */
1291 0x3ffc00, /* src_mask */
1292 0x3ffc00, /* dst_mask */
1293 FALSE), /* pcrel_offset */
1294
1295 /* Same as BFD_RELOC_AARCH64_TLSLD_LDST64_DTPREL_LO12, but no overflow check. */
1296 HOWTO64 (AARCH64_R (TLSLD_LDST64_DTPREL_LO12_NC), /* type */
1297 3, /* rightshift */
1298 2, /* size (0 = byte, 1 = short, 2 = long) */
1299 9, /* bitsize */
1300 FALSE, /* pc_relative */
1301 10, /* bitpos */
1302 complain_overflow_dont, /* complain_on_overflow */
1303 bfd_elf_generic_reloc, /* special_function */
1304 AARCH64_R_STR (TLSLD_LDST64_DTPREL_LO12_NC), /* name */
1305 FALSE, /* partial_inplace */
1306 0x7fc00, /* src_mask */
1307 0x7fc00, /* dst_mask */
1308 FALSE), /* pcrel_offset */
1309
1310 /* LD/ST8: bit[11:0] of byte offset to module TLS base address. */
1311 HOWTO64 (AARCH64_R (TLSLD_LDST8_DTPREL_LO12), /* type */
1312 0, /* rightshift */
1313 2, /* size (0 = byte, 1 = short, 2 = long) */
1314 12, /* bitsize */
1315 FALSE, /* pc_relative */
1316 10, /* bitpos */
1317 complain_overflow_unsigned, /* complain_on_overflow */
1318 bfd_elf_generic_reloc, /* special_function */
1319 AARCH64_R_STR (TLSLD_LDST8_DTPREL_LO12), /* name */
1320 FALSE, /* partial_inplace */
1321 0x3ffc00, /* src_mask */
1322 0x3ffc00, /* dst_mask */
1323 FALSE), /* pcrel_offset */
1324
1325 /* Same as BFD_RELOC_AARCH64_TLSLD_LDST8_DTPREL_LO12, but no overflow check. */
1326 HOWTO64 (AARCH64_R (TLSLD_LDST8_DTPREL_LO12_NC), /* type */
1327 0, /* rightshift */
1328 2, /* size (0 = byte, 1 = short, 2 = long) */
1329 12, /* bitsize */
1330 FALSE, /* pc_relative */
1331 10, /* bitpos */
1332 complain_overflow_dont, /* complain_on_overflow */
1333 bfd_elf_generic_reloc, /* special_function */
1334 AARCH64_R_STR (TLSLD_LDST8_DTPREL_LO12_NC), /* name */
1335 FALSE, /* partial_inplace */
1336 0x3ffc00, /* src_mask */
1337 0x3ffc00, /* dst_mask */
1338 FALSE), /* pcrel_offset */
1339
49df5539
JW		 1340 /* MOVZ: bit[15:0] of byte offset to module TLS base address. */
1341 HOWTO (AARCH64_R (TLSLD_MOVW_DTPREL_G0), /* type */
1342 0, /* rightshift */
1343 2, /* size (0 = byte, 1 = short, 2 = long) */
1344 16, /* bitsize */
1345 FALSE, /* pc_relative */
1346 0, /* bitpos */
1347 complain_overflow_unsigned, /* complain_on_overflow */
1348 bfd_elf_generic_reloc, /* special_function */
1349 AARCH64_R_STR (TLSLD_MOVW_DTPREL_G0), /* name */
1350 FALSE, /* partial_inplace */
1351 0xffff, /* src_mask */
1352 0xffff, /* dst_mask */
1353 FALSE), /* pcrel_offset */
1354
1355 /* No overflow check version of BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G0. */
1356 HOWTO (AARCH64_R (TLSLD_MOVW_DTPREL_G0_NC), /* type */
1357 0, /* rightshift */
1358 2, /* size (0 = byte, 1 = short, 2 = long) */
1359 16, /* bitsize */
1360 FALSE, /* pc_relative */
1361 0, /* bitpos */
1362 complain_overflow_dont, /* complain_on_overflow */
1363 bfd_elf_generic_reloc, /* special_function */
1364 AARCH64_R_STR (TLSLD_MOVW_DTPREL_G0_NC), /* name */
1365 FALSE, /* partial_inplace */
1366 0xffff, /* src_mask */
1367 0xffff, /* dst_mask */
1368 FALSE), /* pcrel_offset */
1369
1370 /* MOVZ: bit[31:16] of byte offset to module TLS base address. */
1371 HOWTO (AARCH64_R (TLSLD_MOVW_DTPREL_G1), /* type */
1372 16, /* rightshift */
1373 2, /* size (0 = byte, 1 = short, 2 = long) */
1374 16, /* bitsize */
1375 FALSE, /* pc_relative */
1376 0, /* bitpos */
1377 complain_overflow_unsigned, /* complain_on_overflow */
1378 bfd_elf_generic_reloc, /* special_function */
1379 AARCH64_R_STR (TLSLD_MOVW_DTPREL_G1), /* name */
1380 FALSE, /* partial_inplace */
1381 0xffff, /* src_mask */
1382 0xffff, /* dst_mask */
1383 FALSE), /* pcrel_offset */
1384
1385 /* No overflow check version of BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G1. */
1386 HOWTO64 (AARCH64_R (TLSLD_MOVW_DTPREL_G1_NC), /* type */
1387 16, /* rightshift */
1388 2, /* size (0 = byte, 1 = short, 2 = long) */
1389 16, /* bitsize */
1390 FALSE, /* pc_relative */
1391 0, /* bitpos */
1392 complain_overflow_dont, /* complain_on_overflow */
1393 bfd_elf_generic_reloc, /* special_function */
1394 AARCH64_R_STR (TLSLD_MOVW_DTPREL_G1_NC), /* name */
1395 FALSE, /* partial_inplace */
1396 0xffff, /* src_mask */
1397 0xffff, /* dst_mask */
1398 FALSE), /* pcrel_offset */
1399
1400 /* MOVZ: bit[47:32] of byte offset to module TLS base address. */
1401 HOWTO64 (AARCH64_R (TLSLD_MOVW_DTPREL_G2), /* type */
1402 32, /* rightshift */
1403 2, /* size (0 = byte, 1 = short, 2 = long) */
1404 16, /* bitsize */
1405 FALSE, /* pc_relative */
1406 0, /* bitpos */
1407 complain_overflow_unsigned, /* complain_on_overflow */
1408 bfd_elf_generic_reloc, /* special_function */
1409 AARCH64_R_STR (TLSLD_MOVW_DTPREL_G2), /* name */
1410 FALSE, /* partial_inplace */
1411 0xffff, /* src_mask */
1412 0xffff, /* dst_mask */
1413 FALSE), /* pcrel_offset */
1414
a6bb11b2 1415 HOWTO64 (AARCH64_R (TLSLE_MOVW_TPREL_G2), /* type */
bb3f9ed8 1416 32, /* rightshift */
a06ea964 1417 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1418 16, /* bitsize */
a06ea964
NC		 1419 FALSE, /* pc_relative */
1420 0, /* bitpos */
0172429c 1421 complain_overflow_unsigned, /* complain_on_overflow */
a06ea964 1422 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1423 AARCH64_R_STR (TLSLE_MOVW_TPREL_G2), /* name */
a06ea964
NC		 1424 FALSE, /* partial_inplace */
1425 0xffff, /* src_mask */
1426 0xffff, /* dst_mask */
1427 FALSE), /* pcrel_offset */
1428
a6bb11b2 1429 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G1), /* type */
bb3f9ed8 1430 16, /* rightshift */
a06ea964 1431 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1432 16, /* bitsize */
a06ea964
NC		 1433 FALSE, /* pc_relative */
1434 0, /* bitpos */
1435 complain_overflow_dont, /* complain_on_overflow */
1436 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1437 AARCH64_R_STR (TLSLE_MOVW_TPREL_G1), /* name */
a06ea964
NC		 1438 FALSE, /* partial_inplace */
1439 0xffff, /* src_mask */
1440 0xffff, /* dst_mask */
1441 FALSE), /* pcrel_offset */
1442
a6bb11b2 1443 HOWTO64 (AARCH64_R (TLSLE_MOVW_TPREL_G1_NC), /* type */
bb3f9ed8 1444 16, /* rightshift */
a06ea964 1445 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1446 16, /* bitsize */
a06ea964
NC		 1447 FALSE, /* pc_relative */
1448 0, /* bitpos */
1449 complain_overflow_dont, /* complain_on_overflow */
1450 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1451 AARCH64_R_STR (TLSLE_MOVW_TPREL_G1_NC), /* name */
a06ea964
NC		 1452 FALSE, /* partial_inplace */
1453 0xffff, /* src_mask */
1454 0xffff, /* dst_mask */
1455 FALSE), /* pcrel_offset */
1456
a6bb11b2 1457 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G0), /* type */
a06ea964
NC		 1458 0, /* rightshift */
1459 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1460 16, /* bitsize */
a06ea964
NC		 1461 FALSE, /* pc_relative */
1462 0, /* bitpos */
1463 complain_overflow_dont, /* complain_on_overflow */
1464 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1465 AARCH64_R_STR (TLSLE_MOVW_TPREL_G0), /* name */
a06ea964
NC		 1466 FALSE, /* partial_inplace */
1467 0xffff, /* src_mask */
1468 0xffff, /* dst_mask */
1469 FALSE), /* pcrel_offset */
1470
a6bb11b2 1471 HOWTO (AARCH64_R (TLSLE_MOVW_TPREL_G0_NC), /* type */
a06ea964
NC		 1472 0, /* rightshift */
1473 2, /* size (0 = byte, 1 = short, 2 = long) */
07875fbc 1474 16, /* bitsize */
a06ea964
NC		 1475 FALSE, /* pc_relative */
1476 0, /* bitpos */
1477 complain_overflow_dont, /* complain_on_overflow */
1478 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1479 AARCH64_R_STR (TLSLE_MOVW_TPREL_G0_NC), /* name */
a06ea964
NC		 1480 FALSE, /* partial_inplace */
1481 0xffff, /* src_mask */
1482 0xffff, /* dst_mask */
1483 FALSE), /* pcrel_offset */
1484
a6bb11b2 1485 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_HI12), /* type */
bb3f9ed8 1486 12, /* rightshift */
a06ea964
NC		 1487 2, /* size (0 = byte, 1 = short, 2 = long) */
1488 12, /* bitsize */
1489 FALSE, /* pc_relative */
1490 0, /* bitpos */
bab91cce 1491 complain_overflow_unsigned, /* complain_on_overflow */
a06ea964 1492 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1493 AARCH64_R_STR (TLSLE_ADD_TPREL_HI12), /* name */
a06ea964
NC		 1494 FALSE, /* partial_inplace */
1495 0xfff, /* src_mask */
1496 0xfff, /* dst_mask */
1497 FALSE), /* pcrel_offset */
1498
a6bb11b2 1499 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_LO12), /* type */
a06ea964
NC		 1500 0, /* rightshift */
1501 2, /* size (0 = byte, 1 = short, 2 = long) */
1502 12, /* bitsize */
1503 FALSE, /* pc_relative */
1504 0, /* bitpos */
36e6c140 1505 complain_overflow_unsigned, /* complain_on_overflow */
a06ea964 1506 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1507 AARCH64_R_STR (TLSLE_ADD_TPREL_LO12), /* name */
a06ea964
NC		 1508 FALSE, /* partial_inplace */
1509 0xfff, /* src_mask */
1510 0xfff, /* dst_mask */
1511 FALSE), /* pcrel_offset */
1512
a6bb11b2 1513 HOWTO (AARCH64_R (TLSLE_ADD_TPREL_LO12_NC), /* type */
a06ea964
NC		 1514 0, /* rightshift */
1515 2, /* size (0 = byte, 1 = short, 2 = long) */
1516 12, /* bitsize */
1517 FALSE, /* pc_relative */
1518 0, /* bitpos */
1519 complain_overflow_dont, /* complain_on_overflow */
1520 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1521 AARCH64_R_STR (TLSLE_ADD_TPREL_LO12_NC), /* name */
a06ea964
NC		 1522 FALSE, /* partial_inplace */
1523 0xfff, /* src_mask */
1524 0xfff, /* dst_mask */
1525 FALSE), /* pcrel_offset */
a06ea964 1526
a6bb11b2 1527 HOWTO (AARCH64_R (TLSDESC_LD_PREL19), /* type */
bb3f9ed8 1528 2, /* rightshift */
a06ea964 1529 2, /* size (0 = byte, 1 = short, 2 = long) */
1ada945d 1530 19, /* bitsize */
a06ea964
NC		 1531 TRUE, /* pc_relative */
1532 0, /* bitpos */
1533 complain_overflow_dont, /* complain_on_overflow */
1534 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1535 AARCH64_R_STR (TLSDESC_LD_PREL19), /* name */
a06ea964 1536 FALSE, /* partial_inplace */
1ada945d
MS		 1537 0x0ffffe0, /* src_mask */
1538 0x0ffffe0, /* dst_mask */
a06ea964
NC		 1539 TRUE), /* pcrel_offset */
1540
a6bb11b2 1541 HOWTO (AARCH64_R (TLSDESC_ADR_PREL21), /* type */
a06ea964
NC		 1542 0, /* rightshift */
1543 2, /* size (0 = byte, 1 = short, 2 = long) */
1544 21, /* bitsize */
1545 TRUE, /* pc_relative */
1546 0, /* bitpos */
1547 complain_overflow_dont, /* complain_on_overflow */
1548 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1549 AARCH64_R_STR (TLSDESC_ADR_PREL21), /* name */
a06ea964
NC		 1550 FALSE, /* partial_inplace */
1551 0x1fffff, /* src_mask */
1552 0x1fffff, /* dst_mask */
1553 TRUE), /* pcrel_offset */
1554
1555 /* Get to the page for the GOT entry for the symbol
1556 (G(S) - P) using an ADRP instruction. */
a6bb11b2 1557 HOWTO (AARCH64_R (TLSDESC_ADR_PAGE21), /* type */
a06ea964
NC		 1558 12, /* rightshift */
1559 2, /* size (0 = byte, 1 = short, 2 = long) */
1560 21, /* bitsize */
1561 TRUE, /* pc_relative */
1562 0, /* bitpos */
1563 complain_overflow_dont, /* complain_on_overflow */
1564 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1565 AARCH64_R_STR (TLSDESC_ADR_PAGE21), /* name */
a06ea964
NC		 1566 FALSE, /* partial_inplace */
1567 0x1fffff, /* src_mask */
1568 0x1fffff, /* dst_mask */
1569 TRUE), /* pcrel_offset */
1570
a6bb11b2
YZ		 1571 /* LD64: GOT offset G(S) & 0xff8. */
1572 HOWTO64 (AARCH64_R (TLSDESC_LD64_LO12_NC), /* type */
a06ea964
NC		 1573 3, /* rightshift */
1574 2, /* size (0 = byte, 1 = short, 2 = long) */
1575 12, /* bitsize */
1576 FALSE, /* pc_relative */
1577 0, /* bitpos */
1578 complain_overflow_dont, /* complain_on_overflow */
1579 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1580 AARCH64_R_STR (TLSDESC_LD64_LO12_NC), /* name */
a06ea964 1581 FALSE, /* partial_inplace */
a6bb11b2
YZ		 1582 0xff8, /* src_mask */
1583 0xff8, /* dst_mask */
1584 FALSE), /* pcrel_offset */
1585
1586 /* LD32: GOT offset G(S) & 0xffc. */
1587 HOWTO32 (AARCH64_R (TLSDESC_LD32_LO12_NC), /* type */
1588 2, /* rightshift */
1589 2, /* size (0 = byte, 1 = short, 2 = long) */
1590 12, /* bitsize */
1591 FALSE, /* pc_relative */
1592 0, /* bitpos */
1593 complain_overflow_dont, /* complain_on_overflow */
1594 bfd_elf_generic_reloc, /* special_function */
1595 AARCH64_R_STR (TLSDESC_LD32_LO12_NC), /* name */
1596 FALSE, /* partial_inplace */
1597 0xffc, /* src_mask */
1598 0xffc, /* dst_mask */
a06ea964
NC		 1599 FALSE), /* pcrel_offset */
1600
1601 /* ADD: GOT offset G(S) & 0xfff. */
a6bb11b2 1602 HOWTO (AARCH64_R (TLSDESC_ADD_LO12_NC), /* type */
a06ea964
NC		 1603 0, /* rightshift */
1604 2, /* size (0 = byte, 1 = short, 2 = long) */
1605 12, /* bitsize */
1606 FALSE, /* pc_relative */
1607 0, /* bitpos */
1608 complain_overflow_dont, /* complain_on_overflow */
1609 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1610 AARCH64_R_STR (TLSDESC_ADD_LO12_NC), /* name */
a06ea964
NC		 1611 FALSE, /* partial_inplace */
1612 0xfff, /* src_mask */
1613 0xfff, /* dst_mask */
1614 FALSE), /* pcrel_offset */
1615
a6bb11b2 1616 HOWTO64 (AARCH64_R (TLSDESC_OFF_G1), /* type */
bb3f9ed8 1617 16, /* rightshift */
a06ea964
NC		 1618 2, /* size (0 = byte, 1 = short, 2 = long) */
1619 12, /* bitsize */
1620 FALSE, /* pc_relative */
1621 0, /* bitpos */
43a357f9 1622 complain_overflow_unsigned, /* complain_on_overflow */
a06ea964 1623 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1624 AARCH64_R_STR (TLSDESC_OFF_G1), /* name */
a06ea964
NC		 1625 FALSE, /* partial_inplace */
1626 0xffff, /* src_mask */
1627 0xffff, /* dst_mask */
1628 FALSE), /* pcrel_offset */
1629
a6bb11b2 1630 HOWTO64 (AARCH64_R (TLSDESC_OFF_G0_NC), /* type */
a06ea964
NC		 1631 0, /* rightshift */
1632 2, /* size (0 = byte, 1 = short, 2 = long) */
1633 12, /* bitsize */
1634 FALSE, /* pc_relative */
1635 0, /* bitpos */
1636 complain_overflow_dont, /* complain_on_overflow */
1637 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1638 AARCH64_R_STR (TLSDESC_OFF_G0_NC), /* name */
a06ea964
NC		 1639 FALSE, /* partial_inplace */
1640 0xffff, /* src_mask */
1641 0xffff, /* dst_mask */
1642 FALSE), /* pcrel_offset */
1643
a6bb11b2 1644 HOWTO64 (AARCH64_R (TLSDESC_LDR), /* type */
a06ea964
NC		 1645 0, /* rightshift */
1646 2, /* size (0 = byte, 1 = short, 2 = long) */
1647 12, /* bitsize */
1648 FALSE, /* pc_relative */
1649 0, /* bitpos */
1650 complain_overflow_dont, /* complain_on_overflow */
1651 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1652 AARCH64_R_STR (TLSDESC_LDR), /* name */
a06ea964
NC		 1653 FALSE, /* partial_inplace */
1654 0x0, /* src_mask */
1655 0x0, /* dst_mask */
1656 FALSE), /* pcrel_offset */
1657
a6bb11b2 1658 HOWTO64 (AARCH64_R (TLSDESC_ADD), /* type */
a06ea964
NC		 1659 0, /* rightshift */
1660 2, /* size (0 = byte, 1 = short, 2 = long) */
1661 12, /* bitsize */
1662 FALSE, /* pc_relative */
1663 0, /* bitpos */
1664 complain_overflow_dont, /* complain_on_overflow */
1665 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1666 AARCH64_R_STR (TLSDESC_ADD), /* name */
a06ea964
NC		 1667 FALSE, /* partial_inplace */
1668 0x0, /* src_mask */
1669 0x0, /* dst_mask */
1670 FALSE), /* pcrel_offset */
1671
a6bb11b2 1672 HOWTO (AARCH64_R (TLSDESC_CALL), /* type */
a06ea964
NC		 1673 0, /* rightshift */
1674 2, /* size (0 = byte, 1 = short, 2 = long) */
7366006f 1675 0, /* bitsize */
a06ea964
NC		 1676 FALSE, /* pc_relative */
1677 0, /* bitpos */
1678 complain_overflow_dont, /* complain_on_overflow */
1679 bfd_elf_generic_reloc, /* special_function */
a6bb11b2 1680 AARCH64_R_STR (TLSDESC_CALL), /* name */
a06ea964
NC		 1681 FALSE, /* partial_inplace */
1682 0x0, /* src_mask */
1683 0x0, /* dst_mask */
1684 FALSE), /* pcrel_offset */
a6bb11b2
YZ		 1685
1686 HOWTO (AARCH64_R (COPY), /* type */
1687 0, /* rightshift */
1688 2, /* size (0 = byte, 1 = short, 2 = long) */
1689 64, /* bitsize */
1690 FALSE, /* pc_relative */
1691 0, /* bitpos */
1692 complain_overflow_bitfield, /* complain_on_overflow */
1693 bfd_elf_generic_reloc, /* special_function */
1694 AARCH64_R_STR (COPY), /* name */
1695 TRUE, /* partial_inplace */
1696 0xffffffff, /* src_mask */
1697 0xffffffff, /* dst_mask */
1698 FALSE), /* pcrel_offset */
1699
1700 HOWTO (AARCH64_R (GLOB_DAT), /* type */
1701 0, /* rightshift */
1702 2, /* size (0 = byte, 1 = short, 2 = long) */
1703 64, /* bitsize */
1704 FALSE, /* pc_relative */
1705 0, /* bitpos */
1706 complain_overflow_bitfield, /* complain_on_overflow */
1707 bfd_elf_generic_reloc, /* special_function */
1708 AARCH64_R_STR (GLOB_DAT), /* name */
1709 TRUE, /* partial_inplace */
1710 0xffffffff, /* src_mask */
1711 0xffffffff, /* dst_mask */
1712 FALSE), /* pcrel_offset */
1713
1714 HOWTO (AARCH64_R (JUMP_SLOT), /* type */
1715 0, /* rightshift */
1716 2, /* size (0 = byte, 1 = short, 2 = long) */
1717 64, /* bitsize */
1718 FALSE, /* pc_relative */
1719 0, /* bitpos */
1720 complain_overflow_bitfield, /* complain_on_overflow */
1721 bfd_elf_generic_reloc, /* special_function */
1722 AARCH64_R_STR (JUMP_SLOT), /* name */
1723 TRUE, /* partial_inplace */
1724 0xffffffff, /* src_mask */
1725 0xffffffff, /* dst_mask */
1726 FALSE), /* pcrel_offset */
1727
1728 HOWTO (AARCH64_R (RELATIVE), /* type */
1729 0, /* rightshift */
1730 2, /* size (0 = byte, 1 = short, 2 = long) */
1731 64, /* bitsize */
1732 FALSE, /* pc_relative */
1733 0, /* bitpos */
1734 complain_overflow_bitfield, /* complain_on_overflow */
1735 bfd_elf_generic_reloc, /* special_function */
1736 AARCH64_R_STR (RELATIVE), /* name */
1737 TRUE, /* partial_inplace */
1738 ALL_ONES, /* src_mask */
1739 ALL_ONES, /* dst_mask */
1740 FALSE), /* pcrel_offset */
1741
1742 HOWTO (AARCH64_R (TLS_DTPMOD), /* type */
1743 0, /* rightshift */
1744 2, /* size (0 = byte, 1 = short, 2 = long) */
1745 64, /* bitsize */
1746 FALSE, /* pc_relative */
1747 0, /* bitpos */
1748 complain_overflow_dont, /* complain_on_overflow */
1749 bfd_elf_generic_reloc, /* special_function */
da0781dc
YZ		 1750#if ARCH_SIZE == 64
1751 AARCH64_R_STR (TLS_DTPMOD64), /* name */
1752#else
a6bb11b2 1753 AARCH64_R_STR (TLS_DTPMOD), /* name */
da0781dc 1754#endif
a6bb11b2
YZ		 1755 FALSE, /* partial_inplace */
1756 0, /* src_mask */
1757 ALL_ONES, /* dst_mask */
1758 FALSE), /* pc_reloffset */
1759
1760 HOWTO (AARCH64_R (TLS_DTPREL), /* type */
1761 0, /* rightshift */
1762 2, /* size (0 = byte, 1 = short, 2 = long) */
1763 64, /* bitsize */
1764 FALSE, /* pc_relative */
1765 0, /* bitpos */
1766 complain_overflow_dont, /* complain_on_overflow */
1767 bfd_elf_generic_reloc, /* special_function */
da0781dc
YZ		 1768#if ARCH_SIZE == 64
1769 AARCH64_R_STR (TLS_DTPREL64), /* name */
1770#else
a6bb11b2 1771 AARCH64_R_STR (TLS_DTPREL), /* name */
da0781dc 1772#endif
a6bb11b2
YZ		 1773 FALSE, /* partial_inplace */
1774 0, /* src_mask */
1775 ALL_ONES, /* dst_mask */
1776 FALSE), /* pcrel_offset */
1777
1778 HOWTO (AARCH64_R (TLS_TPREL), /* type */
1779 0, /* rightshift */
1780 2, /* size (0 = byte, 1 = short, 2 = long) */
1781 64, /* bitsize */
1782 FALSE, /* pc_relative */
1783 0, /* bitpos */
1784 complain_overflow_dont, /* complain_on_overflow */
1785 bfd_elf_generic_reloc, /* special_function */
da0781dc
YZ		 1786#if ARCH_SIZE == 64
1787 AARCH64_R_STR (TLS_TPREL64), /* name */
1788#else
a6bb11b2 1789 AARCH64_R_STR (TLS_TPREL), /* name */
da0781dc 1790#endif
a6bb11b2
YZ		 1791 FALSE, /* partial_inplace */
1792 0, /* src_mask */
1793 ALL_ONES, /* dst_mask */
1794 FALSE), /* pcrel_offset */
1795
1796 HOWTO (AARCH64_R (TLSDESC), /* type */
1797 0, /* rightshift */
1798 2, /* size (0 = byte, 1 = short, 2 = long) */
1799 64, /* bitsize */
1800 FALSE, /* pc_relative */
1801 0, /* bitpos */
1802 complain_overflow_dont, /* complain_on_overflow */
1803 bfd_elf_generic_reloc, /* special_function */
1804 AARCH64_R_STR (TLSDESC), /* name */
1805 FALSE, /* partial_inplace */
1806 0, /* src_mask */
1807 ALL_ONES, /* dst_mask */
1808 FALSE), /* pcrel_offset */
1809
1810 HOWTO (AARCH64_R (IRELATIVE), /* type */
1811 0, /* rightshift */
1812 2, /* size (0 = byte, 1 = short, 2 = long) */
1813 64, /* bitsize */
1814 FALSE, /* pc_relative */
1815 0, /* bitpos */
1816 complain_overflow_bitfield, /* complain_on_overflow */
1817 bfd_elf_generic_reloc, /* special_function */
1818 AARCH64_R_STR (IRELATIVE), /* name */
1819 FALSE, /* partial_inplace */
1820 0, /* src_mask */
1821 ALL_ONES, /* dst_mask */
1822 FALSE), /* pcrel_offset */
1823
1824 EMPTY_HOWTO (0),
a06ea964
NC		 1825};
1826
a6bb11b2
YZ		 1827static reloc_howto_type elfNN_aarch64_howto_none =
1828 HOWTO (R_AARCH64_NONE, /* type */
1829 0, /* rightshift */
6346d5ca 1830 3, /* size (0 = byte, 1 = short, 2 = long) */
a6bb11b2
YZ		 1831 0, /* bitsize */
1832 FALSE, /* pc_relative */
1833 0, /* bitpos */
1834 complain_overflow_dont,/* complain_on_overflow */
1835 bfd_elf_generic_reloc, /* special_function */
1836 "R_AARCH64_NONE", /* name */
1837 FALSE, /* partial_inplace */
1838 0, /* src_mask */
1839 0, /* dst_mask */
1840 FALSE); /* pcrel_offset */
1841
1842/* Given HOWTO, return the bfd internal relocation enumerator. */
1843
1844static bfd_reloc_code_real_type
1845elfNN_aarch64_bfd_reloc_from_howto (reloc_howto_type *howto)
1846{
1847 const int size
1848 = (int) ARRAY_SIZE (elfNN_aarch64_howto_table);
1849 const ptrdiff_t offset
1850 = howto - elfNN_aarch64_howto_table;
1851
1852 if (offset > 0 && offset < size - 1)
1853 return BFD_RELOC_AARCH64_RELOC_START + offset;
1854
1855 if (howto == &elfNN_aarch64_howto_none)
1856 return BFD_RELOC_AARCH64_NONE;
1857
1858 return BFD_RELOC_AARCH64_RELOC_START;
1859}
1860
1861/* Given R_TYPE, return the bfd internal relocation enumerator. */
1862
1863static bfd_reloc_code_real_type
1864elfNN_aarch64_bfd_reloc_from_type (unsigned int r_type)
1865{
1866 static bfd_boolean initialized_p = FALSE;
1867 /* Indexed by R_TYPE, values are offsets in the howto_table. */
1868 static unsigned int offsets[R_AARCH64_end];
1869
1870 if (initialized_p == FALSE)
1871 {
1872 unsigned int i;
1873
1874 for (i = 1; i < ARRAY_SIZE (elfNN_aarch64_howto_table) - 1; ++i)
1875 if (elfNN_aarch64_howto_table[i].type != 0)
1876 offsets[elfNN_aarch64_howto_table[i].type] = i;
1877
1878 initialized_p = TRUE;
1879 }
1880
1881 if (r_type == R_AARCH64_NONE || r_type == R_AARCH64_NULL)
1882 return BFD_RELOC_AARCH64_NONE;
1883
5860e3f8
NC		 1884 /* PR 17512: file: b371e70a. */
1885 if (r_type >= R_AARCH64_end)
1886 {
1887 _bfd_error_handler (_("Invalid AArch64 reloc number: %d"), r_type);
1888 bfd_set_error (bfd_error_bad_value);
1889 return BFD_RELOC_AARCH64_NONE;
1890 }
1891
a6bb11b2
YZ		 1892 return BFD_RELOC_AARCH64_RELOC_START + offsets[r_type];
1893}
1894
1895struct elf_aarch64_reloc_map
1896{
1897 bfd_reloc_code_real_type from;
1898 bfd_reloc_code_real_type to;
1899};
1900
1901/* Map bfd generic reloc to AArch64-specific reloc. */
1902static const struct elf_aarch64_reloc_map elf_aarch64_reloc_map[] =
1903{
1904 {BFD_RELOC_NONE, BFD_RELOC_AARCH64_NONE},
1905
1906 /* Basic data relocations. */
1907 {BFD_RELOC_CTOR, BFD_RELOC_AARCH64_NN},
1908 {BFD_RELOC_64, BFD_RELOC_AARCH64_64},
1909 {BFD_RELOC_32, BFD_RELOC_AARCH64_32},
1910 {BFD_RELOC_16, BFD_RELOC_AARCH64_16},
1911 {BFD_RELOC_64_PCREL, BFD_RELOC_AARCH64_64_PCREL},
1912 {BFD_RELOC_32_PCREL, BFD_RELOC_AARCH64_32_PCREL},
1913 {BFD_RELOC_16_PCREL, BFD_RELOC_AARCH64_16_PCREL},
1914};
1915
1916/* Given the bfd internal relocation enumerator in CODE, return the
1917 corresponding howto entry. */
1918
1919static reloc_howto_type *
1920elfNN_aarch64_howto_from_bfd_reloc (bfd_reloc_code_real_type code)
1921{
1922 unsigned int i;
1923
1924 /* Convert bfd generic reloc to AArch64-specific reloc. */
1925 if (code < BFD_RELOC_AARCH64_RELOC_START
1926 || code > BFD_RELOC_AARCH64_RELOC_END)
1927 for (i = 0; i < ARRAY_SIZE (elf_aarch64_reloc_map); i++)
1928 if (elf_aarch64_reloc_map[i].from == code)
1929 {
1930 code = elf_aarch64_reloc_map[i].to;
1931 break;
1932 }
1933
1934 if (code > BFD_RELOC_AARCH64_RELOC_START
1935 && code < BFD_RELOC_AARCH64_RELOC_END)
1936 if (elfNN_aarch64_howto_table[code - BFD_RELOC_AARCH64_RELOC_START].type)
1937 return &elfNN_aarch64_howto_table[code - BFD_RELOC_AARCH64_RELOC_START];
1938
54757ed1
AP		 1939 if (code == BFD_RELOC_AARCH64_NONE)
1940 return &elfNN_aarch64_howto_none;
1941
a6bb11b2
YZ		 1942 return NULL;
1943}
1944
a06ea964 1945static reloc_howto_type *
cec5225b 1946elfNN_aarch64_howto_from_type (unsigned int r_type)
a06ea964 1947{
a6bb11b2
YZ		 1948 bfd_reloc_code_real_type val;
1949 reloc_howto_type *howto;
1950
cec5225b
YZ		 1951#if ARCH_SIZE == 32
1952 if (r_type > 256)
1953 {
1954 bfd_set_error (bfd_error_bad_value);
1955 return NULL;
1956 }
1957#endif
1958
a6bb11b2
YZ		 1959 if (r_type == R_AARCH64_NONE)
1960 return &elfNN_aarch64_howto_none;
a06ea964 1961
a6bb11b2
YZ		 1962 val = elfNN_aarch64_bfd_reloc_from_type (r_type);
1963 howto = elfNN_aarch64_howto_from_bfd_reloc (val);
a06ea964 1964
a6bb11b2
YZ		 1965 if (howto != NULL)
1966 return howto;
a06ea964 1967
a06ea964
NC		 1968 bfd_set_error (bfd_error_bad_value);
1969 return NULL;
1970}
1971
1972static void
cec5225b 1973elfNN_aarch64_info_to_howto (bfd *abfd ATTRIBUTE_UNUSED, arelent *bfd_reloc,
a06ea964
NC		 1974 Elf_Internal_Rela *elf_reloc)
1975{
1976 unsigned int r_type;
1977
cec5225b
YZ		 1978 r_type = ELFNN_R_TYPE (elf_reloc->r_info);
1979 bfd_reloc->howto = elfNN_aarch64_howto_from_type (r_type);
a06ea964
NC		 1980}
1981
a06ea964 1982static reloc_howto_type *
cec5225b 1983elfNN_aarch64_reloc_type_lookup (bfd *abfd ATTRIBUTE_UNUSED,
a06ea964
NC		 1984 bfd_reloc_code_real_type code)
1985{
a6bb11b2 1986 reloc_howto_type *howto = elfNN_aarch64_howto_from_bfd_reloc (code);
a06ea964 1987
a6bb11b2
YZ		 1988 if (howto != NULL)
1989 return howto;
a06ea964
NC		 1990
1991 bfd_set_error (bfd_error_bad_value);
1992 return NULL;
1993}
1994
1995static reloc_howto_type *
cec5225b 1996elfNN_aarch64_reloc_name_lookup (bfd *abfd ATTRIBUTE_UNUSED,
a06ea964
NC		 1997 const char *r_name)
1998{
1999 unsigned int i;
2000
a6bb11b2
YZ		 2001 for (i = 1; i < ARRAY_SIZE (elfNN_aarch64_howto_table) - 1; ++i)
2002 if (elfNN_aarch64_howto_table[i].name != NULL
2003 && strcasecmp (elfNN_aarch64_howto_table[i].name, r_name) == 0)
2004 return &elfNN_aarch64_howto_table[i];
a06ea964
NC		 2005
2006 return NULL;
2007}
2008
6d00b590 2009#define TARGET_LITTLE_SYM aarch64_elfNN_le_vec
cec5225b 2010#define TARGET_LITTLE_NAME "elfNN-littleaarch64"
6d00b590 2011#define TARGET_BIG_SYM aarch64_elfNN_be_vec
cec5225b 2012#define TARGET_BIG_NAME "elfNN-bigaarch64"
a06ea964 2013
a06ea964
NC		 2014/* The linker script knows the section names for placement.
2015 The entry_names are used to do simple name mangling on the stubs.
2016 Given a function name, and its type, the stub can be found. The
2017 name can be changed. The only requirement is the %s be present. */
2018#define STUB_ENTRY_NAME "__%s_veneer"
2019
2020/* The name of the dynamic interpreter. This is put in the .interp
2021 section. */
2022#define ELF_DYNAMIC_INTERPRETER "/lib/ld.so.1"
2023
2024#define AARCH64_MAX_FWD_BRANCH_OFFSET \
2025 (((1 << 25) - 1) << 2)
2026#define AARCH64_MAX_BWD_BRANCH_OFFSET \
2027 (-((1 << 25) << 2))
2028
2029#define AARCH64_MAX_ADRP_IMM ((1 << 20) - 1)
2030#define AARCH64_MIN_ADRP_IMM (-(1 << 20))
2031
2032static int
2033aarch64_valid_for_adrp_p (bfd_vma value, bfd_vma place)
2034{
2035 bfd_signed_vma offset = (bfd_signed_vma) (PG (value) - PG (place)) >> 12;
2036 return offset <= AARCH64_MAX_ADRP_IMM && offset >= AARCH64_MIN_ADRP_IMM;
2037}
2038
2039static int
2040aarch64_valid_branch_p (bfd_vma value, bfd_vma place)
2041{
2042 bfd_signed_vma offset = (bfd_signed_vma) (value - place);
2043 return (offset <= AARCH64_MAX_FWD_BRANCH_OFFSET
2044 && offset >= AARCH64_MAX_BWD_BRANCH_OFFSET);
2045}
2046
2047static const uint32_t aarch64_adrp_branch_stub [] =
2048{
2049 0x90000010, /* adrp ip0, X */
2050 /* R_AARCH64_ADR_HI21_PCREL(X) */
2051 0x91000210, /* add ip0, ip0, :lo12:X */
2052 /* R_AARCH64_ADD_ABS_LO12_NC(X) */
2053 0xd61f0200, /* br ip0 */
2054};
2055
2056static const uint32_t aarch64_long_branch_stub[] =
2057{
cec5225b 2058#if ARCH_SIZE == 64
a06ea964 2059 0x58000090, /* ldr ip0, 1f */
cec5225b
YZ		 2060#else
2061 0x18000090, /* ldr wip0, 1f */
2062#endif
a06ea964
NC		 2063 0x10000011, /* adr ip1, #0 */
2064 0x8b110210, /* add ip0, ip0, ip1 */
2065 0xd61f0200, /* br ip0 */
cec5225b
YZ		 2066 0x00000000, /* 1: .xword or .word
2067 R_AARCH64_PRELNN(X) + 12
a06ea964
NC		 2068 */
2069 0x00000000,
2070};
2071
68fcca92
JW		 2072static const uint32_t aarch64_erratum_835769_stub[] =
2073{
2074 0x00000000, /* Placeholder for multiply accumulate. */
2075 0x14000000, /* b <label> */
2076};
2077
4106101c
MS		 2078static const uint32_t aarch64_erratum_843419_stub[] =
2079{
2080 0x00000000, /* Placeholder for LDR instruction. */
2081 0x14000000, /* b <label> */
2082};
2083
a06ea964
NC		 2084/* Section name for stubs is the associated section name plus this
2085 string. */
2086#define STUB_SUFFIX ".stub"
2087
cec5225b 2088enum elf_aarch64_stub_type
a06ea964
NC		 2089{
2090 aarch64_stub_none,
2091 aarch64_stub_adrp_branch,
2092 aarch64_stub_long_branch,
68fcca92 2093 aarch64_stub_erratum_835769_veneer,
4106101c 2094 aarch64_stub_erratum_843419_veneer,
a06ea964
NC		 2095};
2096
cec5225b 2097struct elf_aarch64_stub_hash_entry
a06ea964
NC		 2098{
2099 /* Base hash table entry structure. */
2100 struct bfd_hash_entry root;
2101
2102 /* The stub section. */
2103 asection *stub_sec;
2104
2105 /* Offset within stub_sec of the beginning of this stub. */
2106 bfd_vma stub_offset;
2107
2108 /* Given the symbol's value and its section we can determine its final
2109 value when building the stubs (so the stub knows where to jump). */
2110 bfd_vma target_value;
2111 asection *target_section;
2112
cec5225b 2113 enum elf_aarch64_stub_type stub_type;
a06ea964
NC		 2114
2115 /* The symbol table entry, if any, that this was derived from. */
cec5225b 2116 struct elf_aarch64_link_hash_entry *h;
a06ea964
NC		 2117
2118 /* Destination symbol type */
2119 unsigned char st_type;
2120
2121 /* Where this stub is being called from, or, in the case of combined
2122 stub sections, the first input section in the group. */
2123 asection *id_sec;
2124
2125 /* The name for the local symbol at the start of this stub. The
2126 stub name in the hash table has to be unique; this does not, so
2127 it can be friendlier. */
2128 char *output_name;
68fcca92
JW		 2129
2130 /* The instruction which caused this stub to be generated (only valid for
2131 erratum 835769 workaround stubs at present). */
2132 uint32_t veneered_insn;
4106101c
MS		 2133
2134 /* In an erratum 843419 workaround stub, the ADRP instruction offset. */
2135 bfd_vma adrp_offset;
a06ea964
NC		 2136};
2137
2138/* Used to build a map of a section. This is required for mixed-endian
2139 code/data. */
2140
cec5225b 2141typedef struct elf_elf_section_map
a06ea964
NC		 2142{
2143 bfd_vma vma;
2144 char type;
2145}
cec5225b 2146elf_aarch64_section_map;
a06ea964
NC		 2147
2148
2149typedef struct _aarch64_elf_section_data
2150{
2151 struct bfd_elf_section_data elf;
2152 unsigned int mapcount;
2153 unsigned int mapsize;
cec5225b 2154 elf_aarch64_section_map *map;
a06ea964
NC		 2155}
2156_aarch64_elf_section_data;
2157
cec5225b 2158#define elf_aarch64_section_data(sec) \
a06ea964
NC		 2159 ((_aarch64_elf_section_data *) elf_section_data (sec))
2160
4e8516b2
AP		 2161/* The size of the thread control block which is defined to be two pointers. */
2162#define TCB_SIZE (ARCH_SIZE/8)*2
a06ea964
NC		 2163
2164struct elf_aarch64_local_symbol
2165{
2166 unsigned int got_type;
2167 bfd_signed_vma got_refcount;
2168 bfd_vma got_offset;
2169
2170 /* Offset of the GOTPLT entry reserved for the TLS descriptor. The
2171 offset is from the end of the jump table and reserved entries
2172 within the PLTGOT.
2173
2174 The magic value (bfd_vma) -1 indicates that an offset has not be
2175 allocated. */
2176 bfd_vma tlsdesc_got_jump_table_offset;
2177};
2178
2179struct elf_aarch64_obj_tdata
2180{
2181 struct elf_obj_tdata root;
2182
2183 /* local symbol descriptors */
2184 struct elf_aarch64_local_symbol *locals;
2185
2186 /* Zero to warn when linking objects with incompatible enum sizes. */
2187 int no_enum_size_warning;
2188
2189 /* Zero to warn when linking objects with incompatible wchar_t sizes. */
2190 int no_wchar_size_warning;
2191};
2192
2193#define elf_aarch64_tdata(bfd) \
2194 ((struct elf_aarch64_obj_tdata *) (bfd)->tdata.any)
2195
cec5225b 2196#define elf_aarch64_locals(bfd) (elf_aarch64_tdata (bfd)->locals)
a06ea964
NC		 2197
2198#define is_aarch64_elf(bfd) \
2199 (bfd_get_flavour (bfd) == bfd_target_elf_flavour \
2200 && elf_tdata (bfd) != NULL \
2201 && elf_object_id (bfd) == AARCH64_ELF_DATA)
2202
2203static bfd_boolean
cec5225b 2204elfNN_aarch64_mkobject (bfd *abfd)
a06ea964
NC		 2205{
2206 return bfd_elf_allocate_object (abfd, sizeof (struct elf_aarch64_obj_tdata),
2207 AARCH64_ELF_DATA);
2208}
2209
cec5225b
YZ		 2210#define elf_aarch64_hash_entry(ent) \
2211 ((struct elf_aarch64_link_hash_entry *)(ent))
a06ea964
NC		 2212
2213#define GOT_UNKNOWN 0
2214#define GOT_NORMAL 1
2215#define GOT_TLS_GD 2
2216#define GOT_TLS_IE 4
2217#define GOT_TLSDESC_GD 8
2218
2219#define GOT_TLS_GD_ANY_P(type) ((type & GOT_TLS_GD) || (type & GOT_TLSDESC_GD))
2220
2221/* AArch64 ELF linker hash entry. */
cec5225b 2222struct elf_aarch64_link_hash_entry
a06ea964
NC		 2223{
2224 struct elf_link_hash_entry root;
2225
2226 /* Track dynamic relocs copied for this symbol. */
2227 struct elf_dyn_relocs *dyn_relocs;
2228
a06ea964
NC		 2229 /* Since PLT entries have variable size, we need to record the
2230 index into .got.plt instead of recomputing it from the PLT
2231 offset. */
2232 bfd_signed_vma plt_got_offset;
2233
2234 /* Bit mask representing the type of GOT entry(s) if any required by
2235 this symbol. */
2236 unsigned int got_type;
2237
2238 /* A pointer to the most recently used stub hash entry against this
2239 symbol. */
cec5225b 2240 struct elf_aarch64_stub_hash_entry *stub_cache;
a06ea964
NC		 2241
2242 /* Offset of the GOTPLT entry reserved for the TLS descriptor. The offset
2243 is from the end of the jump table and reserved entries within the PLTGOT.
2244
2245 The magic value (bfd_vma) -1 indicates that an offset has not
2246 be allocated. */
2247 bfd_vma tlsdesc_got_jump_table_offset;
2248};
2249
2250static unsigned int
cec5225b 2251elfNN_aarch64_symbol_got_type (struct elf_link_hash_entry *h,
a06ea964
NC		 2252 bfd *abfd,
2253 unsigned long r_symndx)
2254{
2255 if (h)
cec5225b 2256 return elf_aarch64_hash_entry (h)->got_type;
a06ea964 2257
cec5225b 2258 if (! elf_aarch64_locals (abfd))
a06ea964
NC		 2259 return GOT_UNKNOWN;
2260
cec5225b 2261 return elf_aarch64_locals (abfd)[r_symndx].got_type;
a06ea964
NC		 2262}
2263
a06ea964 2264/* Get the AArch64 elf linker hash table from a link_info structure. */
cec5225b
YZ		 2265#define elf_aarch64_hash_table(info) \
2266 ((struct elf_aarch64_link_hash_table *) ((info)->hash))
a06ea964
NC		 2267
2268#define aarch64_stub_hash_lookup(table, string, create, copy) \
cec5225b 2269 ((struct elf_aarch64_stub_hash_entry *) \
a06ea964
NC		 2270 bfd_hash_lookup ((table), (string), (create), (copy)))
2271
2272/* AArch64 ELF linker hash table. */
cec5225b 2273struct elf_aarch64_link_hash_table
a06ea964
NC		 2274{
2275 /* The main hash table. */
2276 struct elf_link_hash_table root;
2277
2278 /* Nonzero to force PIC branch veneers. */
2279 int pic_veneer;
2280
68fcca92
JW		 2281 /* Fix erratum 835769. */
2282 int fix_erratum_835769;
2283
4106101c
MS		 2284 /* Fix erratum 843419. */
2285 int fix_erratum_843419;
2286
2287 /* Enable ADRP->ADR rewrite for erratum 843419 workaround. */
2288 int fix_erratum_843419_adr;
2289
1f56df9d
JW		 2290 /* Don't apply link-time values for dynamic relocations. */
2291 int no_apply_dynamic_relocs;
2292
a06ea964
NC		 2293 /* The number of bytes in the initial entry in the PLT. */
2294 bfd_size_type plt_header_size;
2295
2296 /* The number of bytes in the subsequent PLT etries. */
2297 bfd_size_type plt_entry_size;
2298
2299 /* Short-cuts to get to dynamic linker sections. */
2300 asection *sdynbss;
2301 asection *srelbss;
2302
2303 /* Small local sym cache. */
2304 struct sym_cache sym_cache;
2305
2306 /* For convenience in allocate_dynrelocs. */
2307 bfd *obfd;
2308
2309 /* The amount of space used by the reserved portion of the sgotplt
2310 section, plus whatever space is used by the jump slots. */
2311 bfd_vma sgotplt_jump_table_size;
2312
2313 /* The stub hash table. */
2314 struct bfd_hash_table stub_hash_table;
2315
2316 /* Linker stub bfd. */
2317 bfd *stub_bfd;
2318
2319 /* Linker call-backs. */
2320 asection *(*add_stub_section) (const char *, asection *);
2321 void (*layout_sections_again) (void);
2322
2323 /* Array to keep track of which stub sections have been created, and
2324 information on stub grouping. */
2325 struct map_stub
2326 {
2327 /* This is the section to which stubs in the group will be
2328 attached. */
2329 asection *link_sec;
2330 /* The stub section. */
2331 asection *stub_sec;
2332 } *stub_group;
2333
cec5225b 2334 /* Assorted information used by elfNN_aarch64_size_stubs. */
a06ea964 2335 unsigned int bfd_count;
7292b3ac 2336 unsigned int top_index;
a06ea964
NC		 2337 asection **input_list;
2338
2339 /* The offset into splt of the PLT entry for the TLS descriptor
2340 resolver. Special values are 0, if not necessary (or not found
2341 to be necessary yet), and -1 if needed but not determined
2342 yet. */
2343 bfd_vma tlsdesc_plt;
2344
2345 /* The GOT offset for the lazy trampoline. Communicated to the
2346 loader via DT_TLSDESC_GOT. The magic value (bfd_vma) -1
2347 indicates an offset is not allocated. */
2348 bfd_vma dt_tlsdesc_got;
1419bbe5
WN		 2349
2350 /* Used by local STT_GNU_IFUNC symbols. */
2351 htab_t loc_hash_table;
2352 void * loc_hash_memory;
a06ea964
NC		 2353};
2354
a06ea964
NC		 2355/* Create an entry in an AArch64 ELF linker hash table. */
2356
2357static struct bfd_hash_entry *
cec5225b 2358elfNN_aarch64_link_hash_newfunc (struct bfd_hash_entry *entry,
a06ea964
NC		 2359 struct bfd_hash_table *table,
2360 const char *string)
2361{
cec5225b
YZ		 2362 struct elf_aarch64_link_hash_entry *ret =
2363 (struct elf_aarch64_link_hash_entry *) entry;
a06ea964
NC		 2364
2365 /* Allocate the structure if it has not already been allocated by a
2366 subclass. */
2367 if (ret == NULL)
2368 ret = bfd_hash_allocate (table,
cec5225b 2369 sizeof (struct elf_aarch64_link_hash_entry));
a06ea964
NC		 2370 if (ret == NULL)
2371 return (struct bfd_hash_entry *) ret;
2372
2373 /* Call the allocation method of the superclass. */
cec5225b 2374 ret = ((struct elf_aarch64_link_hash_entry *)
a06ea964
NC		 2375 _bfd_elf_link_hash_newfunc ((struct bfd_hash_entry *) ret,
2376 table, string));
2377 if (ret != NULL)
2378 {
2379 ret->dyn_relocs = NULL;
a06ea964
NC		 2380 ret->got_type = GOT_UNKNOWN;
2381 ret->plt_got_offset = (bfd_vma) - 1;
2382 ret->stub_cache = NULL;
2383 ret->tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
2384 }
2385
2386 return (struct bfd_hash_entry *) ret;
2387}
2388
2389/* Initialize an entry in the stub hash table. */
2390
2391static struct bfd_hash_entry *
2392stub_hash_newfunc (struct bfd_hash_entry *entry,
2393 struct bfd_hash_table *table, const char *string)
2394{
2395 /* Allocate the structure if it has not already been allocated by a
2396 subclass. */
2397 if (entry == NULL)
2398 {
2399 entry = bfd_hash_allocate (table,
2400 sizeof (struct
cec5225b 2401 elf_aarch64_stub_hash_entry));
a06ea964
NC		 2402 if (entry == NULL)
2403 return entry;
2404 }
2405
2406 /* Call the allocation method of the superclass. */
2407 entry = bfd_hash_newfunc (entry, table, string);
2408 if (entry != NULL)
2409 {
cec5225b 2410 struct elf_aarch64_stub_hash_entry *eh;
a06ea964
NC		 2411
2412 /* Initialize the local fields. */
cec5225b 2413 eh = (struct elf_aarch64_stub_hash_entry *) entry;
4106101c 2414 eh->adrp_offset = 0;
a06ea964
NC		 2415 eh->stub_sec = NULL;
2416 eh->stub_offset = 0;
2417 eh->target_value = 0;
2418 eh->target_section = NULL;
2419 eh->stub_type = aarch64_stub_none;
2420 eh->h = NULL;
2421 eh->id_sec = NULL;
2422 }
2423
2424 return entry;
2425}
2426
1419bbe5
WN		 2427/* Compute a hash of a local hash entry. We use elf_link_hash_entry
2428 for local symbol so that we can handle local STT_GNU_IFUNC symbols
2429 as global symbol. We reuse indx and dynstr_index for local symbol
2430 hash since they aren't used by global symbols in this backend. */
2431
2432static hashval_t
2433elfNN_aarch64_local_htab_hash (const void *ptr)
2434{
2435 struct elf_link_hash_entry *h
2436 = (struct elf_link_hash_entry *) ptr;
2437 return ELF_LOCAL_SYMBOL_HASH (h->indx, h->dynstr_index);
2438}
2439
2440/* Compare local hash entries. */
2441
2442static int
2443elfNN_aarch64_local_htab_eq (const void *ptr1, const void *ptr2)
2444{
2445 struct elf_link_hash_entry *h1
2446 = (struct elf_link_hash_entry *) ptr1;
2447 struct elf_link_hash_entry *h2
2448 = (struct elf_link_hash_entry *) ptr2;
2449
2450 return h1->indx == h2->indx && h1->dynstr_index == h2->dynstr_index;
2451}
2452
2453/* Find and/or create a hash entry for local symbol. */
2454
2455static struct elf_link_hash_entry *
2456elfNN_aarch64_get_local_sym_hash (struct elf_aarch64_link_hash_table *htab,
2457 bfd *abfd, const Elf_Internal_Rela *rel,
2458 bfd_boolean create)
2459{
2460 struct elf_aarch64_link_hash_entry e, *ret;
2461 asection *sec = abfd->sections;
2462 hashval_t h = ELF_LOCAL_SYMBOL_HASH (sec->id,
2463 ELFNN_R_SYM (rel->r_info));
2464 void **slot;
2465
2466 e.root.indx = sec->id;
2467 e.root.dynstr_index = ELFNN_R_SYM (rel->r_info);
2468 slot = htab_find_slot_with_hash (htab->loc_hash_table, &e, h,
2469 create ? INSERT : NO_INSERT);
2470
2471 if (!slot)
2472 return NULL;
2473
2474 if (*slot)
2475 {
2476 ret = (struct elf_aarch64_link_hash_entry *) *slot;
2477 return &ret->root;
2478 }
2479
2480 ret = (struct elf_aarch64_link_hash_entry *)
2481 objalloc_alloc ((struct objalloc *) htab->loc_hash_memory,
2482 sizeof (struct elf_aarch64_link_hash_entry));
2483 if (ret)
2484 {
2485 memset (ret, 0, sizeof (*ret));
2486 ret->root.indx = sec->id;
2487 ret->root.dynstr_index = ELFNN_R_SYM (rel->r_info);
2488 ret->root.dynindx = -1;
2489 *slot = ret;
2490 }
2491 return &ret->root;
2492}
a06ea964
NC		 2493
2494/* Copy the extra info we tack onto an elf_link_hash_entry. */
2495
2496static void
cec5225b 2497elfNN_aarch64_copy_indirect_symbol (struct bfd_link_info *info,
a06ea964
NC		 2498 struct elf_link_hash_entry *dir,
2499 struct elf_link_hash_entry *ind)
2500{
cec5225b 2501 struct elf_aarch64_link_hash_entry *edir, *eind;
a06ea964 2502
cec5225b
YZ		 2503 edir = (struct elf_aarch64_link_hash_entry *) dir;
2504 eind = (struct elf_aarch64_link_hash_entry *) ind;
a06ea964
NC		 2505
2506 if (eind->dyn_relocs != NULL)
2507 {
2508 if (edir->dyn_relocs != NULL)
2509 {
2510 struct elf_dyn_relocs **pp;
2511 struct elf_dyn_relocs *p;
2512
2513 /* Add reloc counts against the indirect sym to the direct sym
2514 list. Merge any entries against the same section. */
2515 for (pp = &eind->dyn_relocs; (p = *pp) != NULL;)
2516 {
2517 struct elf_dyn_relocs *q;
2518
2519 for (q = edir->dyn_relocs; q != NULL; q = q->next)
2520 if (q->sec == p->sec)
2521 {
2522 q->pc_count += p->pc_count;
2523 q->count += p->count;
2524 *pp = p->next;
2525 break;
2526 }
2527 if (q == NULL)
2528 pp = &p->next;
2529 }
2530 *pp = edir->dyn_relocs;
2531 }
2532
2533 edir->dyn_relocs = eind->dyn_relocs;
2534 eind->dyn_relocs = NULL;
2535 }
2536
a06ea964
NC		 2537 if (ind->root.type == bfd_link_hash_indirect)
2538 {
2539 /* Copy over PLT info. */
2540 if (dir->got.refcount <= 0)
2541 {
2542 edir->got_type = eind->got_type;
2543 eind->got_type = GOT_UNKNOWN;
2544 }
2545 }
2546
2547 _bfd_elf_link_hash_copy_indirect (info, dir, ind);
2548}
2549
68faa637
AM		 2550/* Destroy an AArch64 elf linker hash table. */
2551
2552static void
d495ab0d 2553elfNN_aarch64_link_hash_table_free (bfd *obfd)
68faa637
AM		 2554{
2555 struct elf_aarch64_link_hash_table *ret
d495ab0d 2556 = (struct elf_aarch64_link_hash_table *) obfd->link.hash;
68faa637
AM		 2557
2558 if (ret->loc_hash_table)
2559 htab_delete (ret->loc_hash_table);
2560 if (ret->loc_hash_memory)
2561 objalloc_free ((struct objalloc *) ret->loc_hash_memory);
2562
2563 bfd_hash_table_free (&ret->stub_hash_table);
d495ab0d 2564 _bfd_elf_link_hash_table_free (obfd);
68faa637
AM		 2565}
2566
a06ea964
NC		 2567/* Create an AArch64 elf linker hash table. */
2568
2569static struct bfd_link_hash_table *
cec5225b 2570elfNN_aarch64_link_hash_table_create (bfd *abfd)
a06ea964 2571{
cec5225b
YZ		 2572 struct elf_aarch64_link_hash_table *ret;
2573 bfd_size_type amt = sizeof (struct elf_aarch64_link_hash_table);
a06ea964 2574
7bf52ea2 2575 ret = bfd_zmalloc (amt);
a06ea964
NC		 2576 if (ret == NULL)
2577 return NULL;
2578
2579 if (!_bfd_elf_link_hash_table_init
cec5225b
YZ		 2580 (&ret->root, abfd, elfNN_aarch64_link_hash_newfunc,
2581 sizeof (struct elf_aarch64_link_hash_entry), AARCH64_ELF_DATA))
a06ea964
NC		 2582 {
2583 free (ret);
2584 return NULL;
2585 }
2586
a06ea964
NC		 2587 ret->plt_header_size = PLT_ENTRY_SIZE;
2588 ret->plt_entry_size = PLT_SMALL_ENTRY_SIZE;
a06ea964 2589 ret->obfd = abfd;
a06ea964
NC		 2590 ret->dt_tlsdesc_got = (bfd_vma) - 1;
2591
2592 if (!bfd_hash_table_init (&ret->stub_hash_table, stub_hash_newfunc,
cec5225b 2593 sizeof (struct elf_aarch64_stub_hash_entry)))
a06ea964 2594 {
d495ab0d 2595 _bfd_elf_link_hash_table_free (abfd);
a06ea964
NC		 2596 return NULL;
2597 }
2598
1419bbe5
WN		 2599 ret->loc_hash_table = htab_try_create (1024,
2600 elfNN_aarch64_local_htab_hash,
2601 elfNN_aarch64_local_htab_eq,
2602 NULL);
2603 ret->loc_hash_memory = objalloc_create ();
2604 if (!ret->loc_hash_table || !ret->loc_hash_memory)
2605 {
d495ab0d 2606 elfNN_aarch64_link_hash_table_free (abfd);
1419bbe5
WN		 2607 return NULL;
2608 }
d495ab0d 2609 ret->root.root.hash_table_free = elfNN_aarch64_link_hash_table_free;
1419bbe5 2610
a06ea964
NC		 2611 return &ret->root.root;
2612}
2613
a06ea964
NC		 2614static bfd_boolean
2615aarch64_relocate (unsigned int r_type, bfd *input_bfd, asection *input_section,
2616 bfd_vma offset, bfd_vma value)
2617{
2618 reloc_howto_type *howto;
2619 bfd_vma place;
2620
cec5225b 2621 howto = elfNN_aarch64_howto_from_type (r_type);
a06ea964
NC		 2622 place = (input_section->output_section->vma + input_section->output_offset
2623 + offset);
caed7120
YZ		 2624
2625 r_type = elfNN_aarch64_bfd_reloc_from_type (r_type);
2626 value = _bfd_aarch64_elf_resolve_relocation (r_type, place, value, 0, FALSE);
2627 return _bfd_aarch64_elf_put_addend (input_bfd,
2628 input_section->contents + offset, r_type,
2629 howto, value);
a06ea964
NC		 2630}
2631
cec5225b 2632static enum elf_aarch64_stub_type
a06ea964
NC		 2633aarch64_select_branch_stub (bfd_vma value, bfd_vma place)
2634{
2635 if (aarch64_valid_for_adrp_p (value, place))
2636 return aarch64_stub_adrp_branch;
2637 return aarch64_stub_long_branch;
2638}
2639
2640/* Determine the type of stub needed, if any, for a call. */
2641
cec5225b 2642static enum elf_aarch64_stub_type
9a228467 2643aarch64_type_of_stub (asection *input_sec,
a06ea964 2644 const Elf_Internal_Rela *rel,
f678ded7 2645 asection *sym_sec,
a06ea964 2646 unsigned char st_type,
a06ea964
NC		 2647 bfd_vma destination)
2648{
2649 bfd_vma location;
2650 bfd_signed_vma branch_offset;
2651 unsigned int r_type;
cec5225b 2652 enum elf_aarch64_stub_type stub_type = aarch64_stub_none;
a06ea964 2653
f678ded7 2654 if (st_type != STT_FUNC
2f340668 2655 && (sym_sec == input_sec))
a06ea964
NC		 2656 return stub_type;
2657
a06ea964
NC		 2658 /* Determine where the call point is. */
2659 location = (input_sec->output_offset
2660 + input_sec->output_section->vma + rel->r_offset);
2661
2662 branch_offset = (bfd_signed_vma) (destination - location);
2663
cec5225b 2664 r_type = ELFNN_R_TYPE (rel->r_info);
a06ea964
NC		 2665
2666 /* We don't want to redirect any old unconditional jump in this way,
2667 only one which is being used for a sibcall, where it is
2668 acceptable for the IP0 and IP1 registers to be clobbered. */
a6bb11b2 2669 if ((r_type == AARCH64_R (CALL26) || r_type == AARCH64_R (JUMP26))
a06ea964
NC		 2670 && (branch_offset > AARCH64_MAX_FWD_BRANCH_OFFSET
2671 || branch_offset < AARCH64_MAX_BWD_BRANCH_OFFSET))
2672 {
2673 stub_type = aarch64_stub_long_branch;
2674 }
2675
2676 return stub_type;
2677}
2678
2679/* Build a name for an entry in the stub hash table. */
2680
2681static char *
cec5225b 2682elfNN_aarch64_stub_name (const asection *input_section,
a06ea964 2683 const asection *sym_sec,
cec5225b 2684 const struct elf_aarch64_link_hash_entry *hash,
a06ea964
NC		 2685 const Elf_Internal_Rela *rel)
2686{
2687 char *stub_name;
2688 bfd_size_type len;
2689
2690 if (hash)
2691 {
2692 len = 8 + 1 + strlen (hash->root.root.root.string) + 1 + 16 + 1;
2693 stub_name = bfd_malloc (len);
2694 if (stub_name != NULL)
2695 snprintf (stub_name, len, "%08x_%s+%" BFD_VMA_FMT "x",
2696 (unsigned int) input_section->id,
2697 hash->root.root.root.string,
2698 rel->r_addend);
2699 }
2700 else
2701 {
2702 len = 8 + 1 + 8 + 1 + 8 + 1 + 16 + 1;
2703 stub_name = bfd_malloc (len);
2704 if (stub_name != NULL)
2705 snprintf (stub_name, len, "%08x_%x:%x+%" BFD_VMA_FMT "x",
2706 (unsigned int) input_section->id,
2707 (unsigned int) sym_sec->id,
cec5225b 2708 (unsigned int) ELFNN_R_SYM (rel->r_info),
a06ea964
NC		 2709 rel->r_addend);
2710 }
2711
2712 return stub_name;
2713}
2714
2715/* Look up an entry in the stub hash. Stub entries are cached because
2716 creating the stub name takes a bit of time. */
2717
cec5225b
YZ		 2718static struct elf_aarch64_stub_hash_entry *
2719elfNN_aarch64_get_stub_entry (const asection *input_section,
a06ea964
NC		 2720 const asection *sym_sec,
2721 struct elf_link_hash_entry *hash,
2722 const Elf_Internal_Rela *rel,
cec5225b 2723 struct elf_aarch64_link_hash_table *htab)
a06ea964 2724{
cec5225b
YZ		 2725 struct elf_aarch64_stub_hash_entry *stub_entry;
2726 struct elf_aarch64_link_hash_entry *h =
2727 (struct elf_aarch64_link_hash_entry *) hash;
a06ea964
NC		 2728 const asection *id_sec;
2729
2730 if ((input_section->flags & SEC_CODE) == 0)
2731 return NULL;
2732
2733 /* If this input section is part of a group of sections sharing one
2734 stub section, then use the id of the first section in the group.
2735 Stub names need to include a section id, as there may well be
2736 more than one stub used to reach say, printf, and we need to
2737 distinguish between them. */
2738 id_sec = htab->stub_group[input_section->id].link_sec;
2739
2740 if (h != NULL && h->stub_cache != NULL
2741 && h->stub_cache->h == h && h->stub_cache->id_sec == id_sec)
2742 {
2743 stub_entry = h->stub_cache;
2744 }
2745 else
2746 {
2747 char *stub_name;
2748
cec5225b 2749 stub_name = elfNN_aarch64_stub_name (id_sec, sym_sec, h, rel);
a06ea964
NC		 2750 if (stub_name == NULL)
2751 return NULL;
2752
2753 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table,
2754 stub_name, FALSE, FALSE);
2755 if (h != NULL)
2756 h->stub_cache = stub_entry;
2757
2758 free (stub_name);
2759 }
2760
2761 return stub_entry;
2762}
2763
a06ea964 2764
66585675
MS		 2765/* Create a stub section. */
2766
2767static asection *
2768_bfd_aarch64_create_stub_section (asection *section,
2769 struct elf_aarch64_link_hash_table *htab)
2770{
2771 size_t namelen;
2772 bfd_size_type len;
2773 char *s_name;
2774
2775 namelen = strlen (section->name);
2776 len = namelen + sizeof (STUB_SUFFIX);
2777 s_name = bfd_alloc (htab->stub_bfd, len);
2778 if (s_name == NULL)
2779 return NULL;
2780
2781 memcpy (s_name, section->name, namelen);
2782 memcpy (s_name + namelen, STUB_SUFFIX, sizeof (STUB_SUFFIX));
2783 return (*htab->add_stub_section) (s_name, section);
2784}
2785
2786
fc6d53be
MS		 2787/* Find or create a stub section for a link section.
2788
2789 Fix or create the stub section used to collect stubs attached to
2790 the specified link section. */
2791
2792static asection *
2793_bfd_aarch64_get_stub_for_link_section (asection *link_section,
2794 struct elf_aarch64_link_hash_table *htab)
2795{
2796 if (htab->stub_group[link_section->id].stub_sec == NULL)
2797 htab->stub_group[link_section->id].stub_sec
2798 = _bfd_aarch64_create_stub_section (link_section, htab);
2799 return htab->stub_group[link_section->id].stub_sec;
2800}
2801
2802
ef857521
MS		 2803/* Find or create a stub section in the stub group for an input
2804 section. */
2805
2806static asection *
2807_bfd_aarch64_create_or_find_stub_sec (asection *section,
2808 struct elf_aarch64_link_hash_table *htab)
a06ea964 2809{
fc6d53be
MS		 2810 asection *link_sec = htab->stub_group[section->id].link_sec;
2811 return _bfd_aarch64_get_stub_for_link_section (link_sec, htab);
ef857521
MS		 2812}
2813
2814
2815/* Add a new stub entry in the stub group associated with an input
2816 section to the stub hash. Not all fields of the new stub entry are
2817 initialised. */
2818
2819static struct elf_aarch64_stub_hash_entry *
2820_bfd_aarch64_add_stub_entry_in_group (const char *stub_name,
2821 asection *section,
2822 struct elf_aarch64_link_hash_table *htab)
2823{
2824 asection *link_sec;
2825 asection *stub_sec;
2826 struct elf_aarch64_stub_hash_entry *stub_entry;
2827
2828 link_sec = htab->stub_group[section->id].link_sec;
2829 stub_sec = _bfd_aarch64_create_or_find_stub_sec (section, htab);
2830
a06ea964
NC		 2831 /* Enter this entry into the linker stub hash table. */
2832 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table, stub_name,
2833 TRUE, FALSE);
2834 if (stub_entry == NULL)
2835 {
695344c0 2836 /* xgettext:c-format */
4eca0228
AM		 2837 _bfd_error_handler (_("%s: cannot create stub entry %s"),
2838 section->owner, stub_name);
a06ea964
NC		 2839 return NULL;
2840 }
2841
2842 stub_entry->stub_sec = stub_sec;
2843 stub_entry->stub_offset = 0;
2844 stub_entry->id_sec = link_sec;
2845
2846 return stub_entry;
2847}
2848
4106101c
MS		 2849/* Add a new stub entry in the final stub section to the stub hash.
2850 Not all fields of the new stub entry are initialised. */
2851
2852static struct elf_aarch64_stub_hash_entry *
2853_bfd_aarch64_add_stub_entry_after (const char *stub_name,
2854 asection *link_section,
2855 struct elf_aarch64_link_hash_table *htab)
2856{
2857 asection *stub_sec;
2858 struct elf_aarch64_stub_hash_entry *stub_entry;
2859
2860 stub_sec = _bfd_aarch64_get_stub_for_link_section (link_section, htab);
2861 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table, stub_name,
2862 TRUE, FALSE);
2863 if (stub_entry == NULL)
2864 {
4eca0228 2865 _bfd_error_handler (_("cannot create stub entry %s"), stub_name);
4106101c
MS		 2866 return NULL;
2867 }
2868
2869 stub_entry->stub_sec = stub_sec;
2870 stub_entry->stub_offset = 0;
2871 stub_entry->id_sec = link_section;
2872
2873 return stub_entry;
2874}
2875
2876
a06ea964
NC		 2877static bfd_boolean
2878aarch64_build_one_stub (struct bfd_hash_entry *gen_entry,
2879 void *in_arg ATTRIBUTE_UNUSED)
2880{
cec5225b 2881 struct elf_aarch64_stub_hash_entry *stub_entry;
a06ea964
NC		 2882 asection *stub_sec;
2883 bfd *stub_bfd;
2884 bfd_byte *loc;
2885 bfd_vma sym_value;
68fcca92
JW		 2886 bfd_vma veneered_insn_loc;
2887 bfd_vma veneer_entry_loc;
2888 bfd_signed_vma branch_offset = 0;
a06ea964
NC		 2889 unsigned int template_size;
2890 const uint32_t *template;
2891 unsigned int i;
2892
2893 /* Massage our args to the form they really have. */
cec5225b 2894 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
a06ea964
NC		 2895
2896 stub_sec = stub_entry->stub_sec;
2897
2898 /* Make a note of the offset within the stubs for this entry. */
2899 stub_entry->stub_offset = stub_sec->size;
2900 loc = stub_sec->contents + stub_entry->stub_offset;
2901
2902 stub_bfd = stub_sec->owner;
2903
2904 /* This is the address of the stub destination. */
2905 sym_value = (stub_entry->target_value
2906 + stub_entry->target_section->output_offset
2907 + stub_entry->target_section->output_section->vma);
2908
2909 if (stub_entry->stub_type == aarch64_stub_long_branch)
2910 {
2911 bfd_vma place = (stub_entry->stub_offset + stub_sec->output_section->vma
2912 + stub_sec->output_offset);
2913
2914 /* See if we can relax the stub. */
2915 if (aarch64_valid_for_adrp_p (sym_value, place))
2916 stub_entry->stub_type = aarch64_select_branch_stub (sym_value, place);
2917 }
2918
2919 switch (stub_entry->stub_type)
2920 {
2921 case aarch64_stub_adrp_branch:
2922 template = aarch64_adrp_branch_stub;
2923 template_size = sizeof (aarch64_adrp_branch_stub);
2924 break;
2925 case aarch64_stub_long_branch:
2926 template = aarch64_long_branch_stub;
2927 template_size = sizeof (aarch64_long_branch_stub);
2928 break;
68fcca92
JW		 2929 case aarch64_stub_erratum_835769_veneer:
2930 template = aarch64_erratum_835769_stub;
2931 template_size = sizeof (aarch64_erratum_835769_stub);
2932 break;
4106101c
MS		 2933 case aarch64_stub_erratum_843419_veneer:
2934 template = aarch64_erratum_843419_stub;
2935 template_size = sizeof (aarch64_erratum_843419_stub);
2936 break;
a06ea964 2937 default:
8e2fe09f 2938 abort ();
a06ea964
NC		 2939 }
2940
2941 for (i = 0; i < (template_size / sizeof template[0]); i++)
2942 {
2943 bfd_putl32 (template[i], loc);
2944 loc += 4;
2945 }
2946
2947 template_size = (template_size + 7) & ~7;
2948 stub_sec->size += template_size;
2949
2950 switch (stub_entry->stub_type)
2951 {
2952 case aarch64_stub_adrp_branch:
a6bb11b2 2953 if (aarch64_relocate (AARCH64_R (ADR_PREL_PG_HI21), stub_bfd, stub_sec,
a06ea964
NC		 2954 stub_entry->stub_offset, sym_value))
2955 /* The stub would not have been relaxed if the offset was out
2956 of range. */
2957 BFD_FAIL ();
2958
93ca8569
TB		 2959 if (aarch64_relocate (AARCH64_R (ADD_ABS_LO12_NC), stub_bfd, stub_sec,
2960 stub_entry->stub_offset + 4, sym_value))
2961 BFD_FAIL ();
a06ea964
NC		 2962 break;
2963
2964 case aarch64_stub_long_branch:
2965 /* We want the value relative to the address 12 bytes back from the
2966 value itself. */
93ca8569
TB		 2967 if (aarch64_relocate (AARCH64_R (PRELNN), stub_bfd, stub_sec,
2968 stub_entry->stub_offset + 16, sym_value + 12))
2969 BFD_FAIL ();
a06ea964 2970 break;
68fcca92
JW		 2971
2972 case aarch64_stub_erratum_835769_veneer:
2973 veneered_insn_loc = stub_entry->target_section->output_section->vma
2974 + stub_entry->target_section->output_offset
2975 + stub_entry->target_value;
2976 veneer_entry_loc = stub_entry->stub_sec->output_section->vma
2977 + stub_entry->stub_sec->output_offset
2978 + stub_entry->stub_offset;
2979 branch_offset = veneered_insn_loc - veneer_entry_loc;
2980 branch_offset >>= 2;
2981 branch_offset &= 0x3ffffff;
2982 bfd_putl32 (stub_entry->veneered_insn,
2983 stub_sec->contents + stub_entry->stub_offset);
2984 bfd_putl32 (template[1] | branch_offset,
2985 stub_sec->contents + stub_entry->stub_offset + 4);
2986 break;
2987
4106101c
MS		 2988 case aarch64_stub_erratum_843419_veneer:
2989 if (aarch64_relocate (AARCH64_R (JUMP26), stub_bfd, stub_sec,
2990 stub_entry->stub_offset + 4, sym_value + 4))
2991 BFD_FAIL ();
2992 break;
2993
a06ea964 2994 default:
8e2fe09f 2995 abort ();
a06ea964
NC		 2996 }
2997
2998 return TRUE;
2999}
3000
3001/* As above, but don't actually build the stub. Just bump offset so
3002 we know stub section sizes. */
3003
3004static bfd_boolean
3005aarch64_size_one_stub (struct bfd_hash_entry *gen_entry,
3006 void *in_arg ATTRIBUTE_UNUSED)
3007{
cec5225b 3008 struct elf_aarch64_stub_hash_entry *stub_entry;
a06ea964
NC		 3009 int size;
3010
3011 /* Massage our args to the form they really have. */
cec5225b 3012 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
a06ea964
NC		 3013
3014 switch (stub_entry->stub_type)
3015 {
3016 case aarch64_stub_adrp_branch:
3017 size = sizeof (aarch64_adrp_branch_stub);
3018 break;
3019 case aarch64_stub_long_branch:
3020 size = sizeof (aarch64_long_branch_stub);
3021 break;
68fcca92
JW		 3022 case aarch64_stub_erratum_835769_veneer:
3023 size = sizeof (aarch64_erratum_835769_stub);
3024 break;
4106101c
MS		 3025 case aarch64_stub_erratum_843419_veneer:
3026 size = sizeof (aarch64_erratum_843419_stub);
3027 break;
a06ea964 3028 default:
8e2fe09f 3029 abort ();
a06ea964
NC		 3030 }
3031
3032 size = (size + 7) & ~7;
3033 stub_entry->stub_sec->size += size;
3034 return TRUE;
3035}
3036
3037/* External entry points for sizing and building linker stubs. */
3038
3039/* Set up various things so that we can make a list of input sections
3040 for each output section included in the link. Returns -1 on error,
3041 0 when no stubs will be needed, and 1 on success. */
3042
3043int
cec5225b 3044elfNN_aarch64_setup_section_lists (bfd *output_bfd,
a06ea964
NC		 3045 struct bfd_link_info *info)
3046{
3047 bfd *input_bfd;
3048 unsigned int bfd_count;
7292b3ac 3049 unsigned int top_id, top_index;
a06ea964
NC		 3050 asection *section;
3051 asection **input_list, **list;
3052 bfd_size_type amt;
cec5225b
YZ		 3053 struct elf_aarch64_link_hash_table *htab =
3054 elf_aarch64_hash_table (info);
a06ea964
NC		 3055
3056 if (!is_elf_hash_table (htab))
3057 return 0;
3058
3059 /* Count the number of input BFDs and find the top input section id. */
3060 for (input_bfd = info->input_bfds, bfd_count = 0, top_id = 0;
c72f2fb2 3061 input_bfd != NULL; input_bfd = input_bfd->link.next)
a06ea964
NC		 3062 {
3063 bfd_count += 1;
3064 for (section = input_bfd->sections;
3065 section != NULL; section = section->next)
3066 {
3067 if (top_id < section->id)
3068 top_id = section->id;
3069 }
3070 }
3071 htab->bfd_count = bfd_count;
3072
3073 amt = sizeof (struct map_stub) * (top_id + 1);
3074 htab->stub_group = bfd_zmalloc (amt);
3075 if (htab->stub_group == NULL)
3076 return -1;
3077
3078 /* We can't use output_bfd->section_count here to find the top output
3079 section index as some sections may have been removed, and
3080 _bfd_strip_section_from_output doesn't renumber the indices. */
3081 for (section = output_bfd->sections, top_index = 0;
3082 section != NULL; section = section->next)
3083 {
3084 if (top_index < section->index)
3085 top_index = section->index;
3086 }
3087
3088 htab->top_index = top_index;
3089 amt = sizeof (asection *) * (top_index + 1);
3090 input_list = bfd_malloc (amt);
3091 htab->input_list = input_list;
3092 if (input_list == NULL)
3093 return -1;
3094
3095 /* For sections we aren't interested in, mark their entries with a
3096 value we can check later. */
3097 list = input_list + top_index;
3098 do
3099 *list = bfd_abs_section_ptr;
3100 while (list-- != input_list);
3101
3102 for (section = output_bfd->sections;
3103 section != NULL; section = section->next)
3104 {
3105 if ((section->flags & SEC_CODE) != 0)
3106 input_list[section->index] = NULL;
3107 }
3108
3109 return 1;
3110}
3111
cec5225b 3112/* Used by elfNN_aarch64_next_input_section and group_sections. */
a06ea964
NC		 3113#define PREV_SEC(sec) (htab->stub_group[(sec)->id].link_sec)
3114
3115/* The linker repeatedly calls this function for each input section,
3116 in the order that input sections are linked into output sections.
3117 Build lists of input sections to determine groupings between which
3118 we may insert linker stubs. */
3119
3120void
cec5225b 3121elfNN_aarch64_next_input_section (struct bfd_link_info *info, asection *isec)
a06ea964 3122{
cec5225b
YZ		 3123 struct elf_aarch64_link_hash_table *htab =
3124 elf_aarch64_hash_table (info);
a06ea964
NC		 3125
3126 if (isec->output_section->index <= htab->top_index)
3127 {
3128 asection **list = htab->input_list + isec->output_section->index;
3129
3130 if (*list != bfd_abs_section_ptr)
3131 {
3132 /* Steal the link_sec pointer for our list. */
3133 /* This happens to make the list in reverse order,
3134 which is what we want. */
3135 PREV_SEC (isec) = *list;
3136 *list = isec;
3137 }
3138 }
3139}
3140
3141/* See whether we can group stub sections together. Grouping stub
3142 sections may result in fewer stubs. More importantly, we need to
3143 put all .init* and .fini* stubs at the beginning of the .init or
3144 .fini output sections respectively, because glibc splits the
3145 _init and _fini functions into multiple parts. Putting a stub in
3146 the middle of a function is not a good idea. */
3147
3148static void
cec5225b 3149group_sections (struct elf_aarch64_link_hash_table *htab,
a06ea964
NC		 3150 bfd_size_type stub_group_size,
3151 bfd_boolean stubs_always_before_branch)
3152{
3153 asection **list = htab->input_list + htab->top_index;
3154
3155 do
3156 {
3157 asection *tail = *list;
3158
3159 if (tail == bfd_abs_section_ptr)
3160 continue;
3161
3162 while (tail != NULL)
3163 {
3164 asection *curr;
3165 asection *prev;
3166 bfd_size_type total;
3167
3168 curr = tail;
3169 total = tail->size;
3170 while ((prev = PREV_SEC (curr)) != NULL
3171 && ((total += curr->output_offset - prev->output_offset)
3172 < stub_group_size))
3173 curr = prev;
3174
3175 /* OK, the size from the start of CURR to the end is less
3176 than stub_group_size and thus can be handled by one stub
3177 section. (Or the tail section is itself larger than
3178 stub_group_size, in which case we may be toast.)
3179 We should really be keeping track of the total size of
3180 stubs added here, as stubs contribute to the final output
3181 section size. */
3182 do
3183 {
3184 prev = PREV_SEC (tail);
3185 /* Set up this stub group. */
3186 htab->stub_group[tail->id].link_sec = curr;
3187 }
3188 while (tail != curr && (tail = prev) != NULL);
3189
3190 /* But wait, there's more! Input sections up to stub_group_size
3191 bytes before the stub section can be handled by it too. */
3192 if (!stubs_always_before_branch)
3193 {
3194 total = 0;
3195 while (prev != NULL
3196 && ((total += tail->output_offset - prev->output_offset)
3197 < stub_group_size))
3198 {
3199 tail = prev;
3200 prev = PREV_SEC (tail);
3201 htab->stub_group[tail->id].link_sec = curr;
3202 }
3203 }
3204 tail = prev;
3205 }
3206 }
3207 while (list-- != htab->input_list);
3208
3209 free (htab->input_list);
3210}
3211
3212#undef PREV_SEC
3213
68fcca92
JW		 3214#define AARCH64_BITS(x, pos, n) (((x) >> (pos)) & ((1 << (n)) - 1))
3215
3216#define AARCH64_RT(insn) AARCH64_BITS (insn, 0, 5)
3217#define AARCH64_RT2(insn) AARCH64_BITS (insn, 10, 5)
3218#define AARCH64_RA(insn) AARCH64_BITS (insn, 10, 5)
3219#define AARCH64_RD(insn) AARCH64_BITS (insn, 0, 5)
3220#define AARCH64_RN(insn) AARCH64_BITS (insn, 5, 5)
3221#define AARCH64_RM(insn) AARCH64_BITS (insn, 16, 5)
3222
3223#define AARCH64_MAC(insn) (((insn) & 0xff000000) == 0x9b000000)
3224#define AARCH64_BIT(insn, n) AARCH64_BITS (insn, n, 1)
3225#define AARCH64_OP31(insn) AARCH64_BITS (insn, 21, 3)
3226#define AARCH64_ZR 0x1f
3227
3228/* All ld/st ops. See C4-182 of the ARM ARM. The encoding space for
3229 LD_PCREL, LDST_RO, LDST_UI and LDST_UIMM cover prefetch ops. */
3230
3231#define AARCH64_LD(insn) (AARCH64_BIT (insn, 22) == 1)
3232#define AARCH64_LDST(insn) (((insn) & 0x0a000000) == 0x08000000)
3233#define AARCH64_LDST_EX(insn) (((insn) & 0x3f000000) == 0x08000000)
3234#define AARCH64_LDST_PCREL(insn) (((insn) & 0x3b000000) == 0x18000000)
3235#define AARCH64_LDST_NAP(insn) (((insn) & 0x3b800000) == 0x28000000)
3236#define AARCH64_LDSTP_PI(insn) (((insn) & 0x3b800000) == 0x28800000)
3237#define AARCH64_LDSTP_O(insn) (((insn) & 0x3b800000) == 0x29000000)
3238#define AARCH64_LDSTP_PRE(insn) (((insn) & 0x3b800000) == 0x29800000)
3239#define AARCH64_LDST_UI(insn) (((insn) & 0x3b200c00) == 0x38000000)
3240#define AARCH64_LDST_PIIMM(insn) (((insn) & 0x3b200c00) == 0x38000400)
3241#define AARCH64_LDST_U(insn) (((insn) & 0x3b200c00) == 0x38000800)
3242#define AARCH64_LDST_PREIMM(insn) (((insn) & 0x3b200c00) == 0x38000c00)
3243#define AARCH64_LDST_RO(insn) (((insn) & 0x3b200c00) == 0x38200800)
3244#define AARCH64_LDST_UIMM(insn) (((insn) & 0x3b000000) == 0x39000000)
3245#define AARCH64_LDST_SIMD_M(insn) (((insn) & 0xbfbf0000) == 0x0c000000)
3246#define AARCH64_LDST_SIMD_M_PI(insn) (((insn) & 0xbfa00000) == 0x0c800000)
3247#define AARCH64_LDST_SIMD_S(insn) (((insn) & 0xbf9f0000) == 0x0d000000)
3248#define AARCH64_LDST_SIMD_S_PI(insn) (((insn) & 0xbf800000) == 0x0d800000)
3249
3d14faea
MS		 3250/* Classify an INSN if it is indeed a load/store.
3251
3252 Return TRUE if INSN is a LD/ST instruction otherwise return FALSE.
3253
3254 For scalar LD/ST instructions PAIR is FALSE, RT is returned and RT2
3255 is set equal to RT.
3256
3257 For LD/ST pair instructions PAIR is TRUE, RT and RT2 are returned.
3258
3259 */
68fcca92
JW		 3260
3261static bfd_boolean
3d14faea 3262aarch64_mem_op_p (uint32_t insn, unsigned int *rt, unsigned int *rt2,
68fcca92
JW		 3263 bfd_boolean *pair, bfd_boolean *load)
3264{
3265 uint32_t opcode;
3266 unsigned int r;
3267 uint32_t opc = 0;
3268 uint32_t v = 0;
3269 uint32_t opc_v = 0;
3270
3271 /* Bail out quickly if INSN doesn't fall into the the load-store
3272 encoding space. */
3273 if (!AARCH64_LDST (insn))
3274 return FALSE;
3275
3276 *pair = FALSE;
3277 *load = FALSE;
3278 if (AARCH64_LDST_EX (insn))
3279 {
3280 *rt = AARCH64_RT (insn);
3d14faea 3281 *rt2 = *rt;
68fcca92
JW		 3282 if (AARCH64_BIT (insn, 21) == 1)
3283 {
3284 *pair = TRUE;
3d14faea 3285 *rt2 = AARCH64_RT2 (insn);
68fcca92
JW		 3286 }
3287 *load = AARCH64_LD (insn);
3288 return TRUE;
3289 }
3290 else if (AARCH64_LDST_NAP (insn)
3291 || AARCH64_LDSTP_PI (insn)
3292 || AARCH64_LDSTP_O (insn)
3293 || AARCH64_LDSTP_PRE (insn))
3294 {
3295 *pair = TRUE;
3296 *rt = AARCH64_RT (insn);
3d14faea 3297 *rt2 = AARCH64_RT2 (insn);
68fcca92
JW		 3298 *load = AARCH64_LD (insn);
3299 return TRUE;
3300 }
3301 else if (AARCH64_LDST_PCREL (insn)
3302 || AARCH64_LDST_UI (insn)
3303 || AARCH64_LDST_PIIMM (insn)
3304 || AARCH64_LDST_U (insn)
3305 || AARCH64_LDST_PREIMM (insn)
3306 || AARCH64_LDST_RO (insn)
3307 || AARCH64_LDST_UIMM (insn))
3308 {
3309 *rt = AARCH64_RT (insn);
3d14faea 3310 *rt2 = *rt;
68fcca92
JW		 3311 if (AARCH64_LDST_PCREL (insn))
3312 *load = TRUE;
3313 opc = AARCH64_BITS (insn, 22, 2);
3314 v = AARCH64_BIT (insn, 26);
3315 opc_v = opc | (v << 2);
3316 *load = (opc_v == 1 || opc_v == 2 || opc_v == 3
3317 || opc_v == 5 || opc_v == 7);
3318 return TRUE;
3319 }
3320 else if (AARCH64_LDST_SIMD_M (insn)
3321 || AARCH64_LDST_SIMD_M_PI (insn))
3322 {
3323 *rt = AARCH64_RT (insn);
3324 *load = AARCH64_BIT (insn, 22);
3325 opcode = (insn >> 12) & 0xf;
3326 switch (opcode)
3327 {
3328 case 0:
3329 case 2:
3d14faea 3330 *rt2 = *rt + 3;
68fcca92
JW		 3331 break;
3332
3333 case 4:
3334 case 6:
3d14faea 3335 *rt2 = *rt + 2;
68fcca92
JW		 3336 break;
3337
3338 case 7:
3d14faea 3339 *rt2 = *rt;
68fcca92
JW		 3340 break;
3341
3342 case 8:
3343 case 10:
3d14faea 3344 *rt2 = *rt + 1;
68fcca92
JW		 3345 break;
3346
3347 default:
3348 return FALSE;
3349 }
3350 return TRUE;
3351 }
3352 else if (AARCH64_LDST_SIMD_S (insn)
3353 || AARCH64_LDST_SIMD_S_PI (insn))
3354 {
3355 *rt = AARCH64_RT (insn);
3356 r = (insn >> 21) & 1;
3357 *load = AARCH64_BIT (insn, 22);
3358 opcode = (insn >> 13) & 0x7;
3359 switch (opcode)
3360 {
3361 case 0:
3362 case 2:
3363 case 4:
3d14faea 3364 *rt2 = *rt + r;
68fcca92
JW		 3365 break;
3366
3367 case 1:
3368 case 3:
3369 case 5:
3d14faea 3370 *rt2 = *rt + (r == 0 ? 2 : 3);
68fcca92
JW		 3371 break;
3372
3373 case 6:
3d14faea 3374 *rt2 = *rt + r;
68fcca92
JW		 3375 break;
3376
3377 case 7:
3d14faea 3378 *rt2 = *rt + (r == 0 ? 2 : 3);
68fcca92
JW		 3379 break;
3380
3381 default:
3382 return FALSE;
3383 }
3384 return TRUE;
3385 }
3386
3387 return FALSE;
3388}
3389
3390/* Return TRUE if INSN is multiply-accumulate. */
3391
3392static bfd_boolean
3393aarch64_mlxl_p (uint32_t insn)
3394{
3395 uint32_t op31 = AARCH64_OP31 (insn);
3396
3397 if (AARCH64_MAC (insn)
3398 && (op31 == 0 || op31 == 1 || op31 == 5)
3399 /* Exclude MUL instructions which are encoded as a multiple accumulate
3400 with RA = XZR. */
3401 && AARCH64_RA (insn) != AARCH64_ZR)
3402 return TRUE;
3403
3404 return FALSE;
3405}
3406
3407/* Some early revisions of the Cortex-A53 have an erratum (835769) whereby
3408 it is possible for a 64-bit multiply-accumulate instruction to generate an
3409 incorrect result. The details are quite complex and hard to
3410 determine statically, since branches in the code may exist in some
3411 circumstances, but all cases end with a memory (load, store, or
3412 prefetch) instruction followed immediately by the multiply-accumulate
3413 operation. We employ a linker patching technique, by moving the potentially
3414 affected multiply-accumulate instruction into a patch region and replacing
3415 the original instruction with a branch to the patch. This function checks
3416 if INSN_1 is the memory operation followed by a multiply-accumulate
3417 operation (INSN_2). Return TRUE if an erratum sequence is found, FALSE
3418 if INSN_1 and INSN_2 are safe. */
3419
3420static bfd_boolean
3421aarch64_erratum_sequence (uint32_t insn_1, uint32_t insn_2)
3422{
3423 uint32_t rt;
3d14faea 3424 uint32_t rt2;
68fcca92
JW		 3425 uint32_t rn;
3426 uint32_t rm;
3427 uint32_t ra;
3428 bfd_boolean pair;
3429 bfd_boolean load;
3430
3431 if (aarch64_mlxl_p (insn_2)
3d14faea 3432 && aarch64_mem_op_p (insn_1, &rt, &rt2, &pair, &load))
68fcca92
JW		 3433 {
3434 /* Any SIMD memory op is independent of the subsequent MLA
3435 by definition of the erratum. */
3436 if (AARCH64_BIT (insn_1, 26))
3437 return TRUE;
3438
3439 /* If not SIMD, check for integer memory ops and MLA relationship. */
3440 rn = AARCH64_RN (insn_2);
3441 ra = AARCH64_RA (insn_2);
3442 rm = AARCH64_RM (insn_2);
3443
3444 /* If this is a load and there's a true(RAW) dependency, we are safe
3445 and this is not an erratum sequence. */
3446 if (load &&
3447 (rt == rn || rt == rm || rt == ra
3d14faea 3448 || (pair && (rt2 == rn || rt2 == rm || rt2 == ra))))
68fcca92
JW		 3449 return FALSE;
3450
3451 /* We conservatively put out stubs for all other cases (including
3452 writebacks). */
3453 return TRUE;
3454 }
3455
3456 return FALSE;
3457}
3458
520c7b56
JW		 3459/* Used to order a list of mapping symbols by address. */
3460
3461static int
3462elf_aarch64_compare_mapping (const void *a, const void *b)
3463{
3464 const elf_aarch64_section_map *amap = (const elf_aarch64_section_map *) a;
3465 const elf_aarch64_section_map *bmap = (const elf_aarch64_section_map *) b;
3466
3467 if (amap->vma > bmap->vma)
3468 return 1;
3469 else if (amap->vma < bmap->vma)
3470 return -1;
3471 else if (amap->type > bmap->type)
3472 /* Ensure results do not depend on the host qsort for objects with
3473 multiple mapping symbols at the same address by sorting on type
3474 after vma. */
3475 return 1;
3476 else if (amap->type < bmap->type)
3477 return -1;
3478 else
3479 return 0;
3480}
3481
2144188d 3482
35fee8b7
MS		 3483static char *
3484_bfd_aarch64_erratum_835769_stub_name (unsigned num_fixes)
3485{
3486 char *stub_name = (char *) bfd_malloc
3487 (strlen ("__erratum_835769_veneer_") + 16);
3488 sprintf (stub_name,"__erratum_835769_veneer_%d", num_fixes);
3489 return stub_name;
3490}
3491
4106101c 3492/* Scan for Cortex-A53 erratum 835769 sequence.
2144188d
MS		 3493
3494 Return TRUE else FALSE on abnormal termination. */
3495
68fcca92 3496static bfd_boolean
5421cc6e
MS		 3497_bfd_aarch64_erratum_835769_scan (bfd *input_bfd,
3498 struct bfd_link_info *info,
3499 unsigned int *num_fixes_p)
68fcca92
JW		 3500{
3501 asection *section;
3502 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
68fcca92 3503 unsigned int num_fixes = *num_fixes_p;
68fcca92
JW		 3504
3505 if (htab == NULL)
2144188d 3506 return TRUE;
68fcca92
JW		 3507
3508 for (section = input_bfd->sections;
3509 section != NULL;
3510 section = section->next)
3511 {
3512 bfd_byte *contents = NULL;
3513 struct _aarch64_elf_section_data *sec_data;
3514 unsigned int span;
3515
3516 if (elf_section_type (section) != SHT_PROGBITS
3517 || (elf_section_flags (section) & SHF_EXECINSTR) == 0
3518 || (section->flags & SEC_EXCLUDE) != 0
3519 || (section->sec_info_type == SEC_INFO_TYPE_JUST_SYMS)
3520 || (section->output_section == bfd_abs_section_ptr))
3521 continue;
3522
3523 if (elf_section_data (section)->this_hdr.contents != NULL)
3524 contents = elf_section_data (section)->this_hdr.contents;
3525 else if (! bfd_malloc_and_get_section (input_bfd, section, &contents))
2144188d 3526 return FALSE;
68fcca92
JW		 3527
3528 sec_data = elf_aarch64_section_data (section);
520c7b56
JW		 3529
3530 qsort (sec_data->map, sec_data->mapcount,
3531 sizeof (elf_aarch64_section_map), elf_aarch64_compare_mapping);
3532
68fcca92
JW		 3533 for (span = 0; span < sec_data->mapcount; span++)
3534 {
3535 unsigned int span_start = sec_data->map[span].vma;
3536 unsigned int span_end = ((span == sec_data->mapcount - 1)
3537 ? sec_data->map[0].vma + section->size
3538 : sec_data->map[span + 1].vma);
3539 unsigned int i;
3540 char span_type = sec_data->map[span].type;
3541
3542 if (span_type == 'd')
3543 continue;
3544
3545 for (i = span_start; i + 4 < span_end; i += 4)
3546 {
3547 uint32_t insn_1 = bfd_getl32 (contents + i);
3548 uint32_t insn_2 = bfd_getl32 (contents + i + 4);
3549
3550 if (aarch64_erratum_sequence (insn_1, insn_2))
3551 {
5421cc6e 3552 struct elf_aarch64_stub_hash_entry *stub_entry;
35fee8b7
MS		 3553 char *stub_name = _bfd_aarch64_erratum_835769_stub_name (num_fixes);
3554 if (! stub_name)
2144188d 3555 return FALSE;
68fcca92 3556
5421cc6e
MS		 3557 stub_entry = _bfd_aarch64_add_stub_entry_in_group (stub_name,
3558 section,
3559 htab);
3560 if (! stub_entry)
3561 return FALSE;
68fcca92 3562
5421cc6e
MS		 3563 stub_entry->stub_type = aarch64_stub_erratum_835769_veneer;
3564 stub_entry->target_section = section;
3565 stub_entry->target_value = i + 4;
3566 stub_entry->veneered_insn = insn_2;
3567 stub_entry->output_name = stub_name;
68fcca92
JW		 3568 num_fixes++;
3569 }
3570 }
3571 }
3572 if (elf_section_data (section)->this_hdr.contents == NULL)
3573 free (contents);
3574 }
3575
357d1523
MS		 3576 *num_fixes_p = num_fixes;
3577
2144188d 3578 return TRUE;
68fcca92
JW		 3579}
3580
13f622ec 3581
4106101c
MS		 3582/* Test if instruction INSN is ADRP. */
3583
3584static bfd_boolean
3585_bfd_aarch64_adrp_p (uint32_t insn)
3586{
3587 return ((insn & 0x9f000000) == 0x90000000);
3588}
3589
3590
3591/* Helper predicate to look for cortex-a53 erratum 843419 sequence 1. */
3592
3593static bfd_boolean
3594_bfd_aarch64_erratum_843419_sequence_p (uint32_t insn_1, uint32_t insn_2,
3595 uint32_t insn_3)
3596{
3597 uint32_t rt;
3598 uint32_t rt2;
3599 bfd_boolean pair;
3600 bfd_boolean load;
3601
3602 return (aarch64_mem_op_p (insn_2, &rt, &rt2, &pair, &load)
3603 && (!pair
3604 || (pair && !load))
3605 && AARCH64_LDST_UIMM (insn_3)
3606 && AARCH64_RN (insn_3) == AARCH64_RD (insn_1));
3607}
3608
3609
3610/* Test for the presence of Cortex-A53 erratum 843419 instruction sequence.
3611
3612 Return TRUE if section CONTENTS at offset I contains one of the
3613 erratum 843419 sequences, otherwise return FALSE. If a sequence is
3614 seen set P_VENEER_I to the offset of the final LOAD/STORE
3615 instruction in the sequence.
3616 */
3617
3618static bfd_boolean
3619_bfd_aarch64_erratum_843419_p (bfd_byte *contents, bfd_vma vma,
3620 bfd_vma i, bfd_vma span_end,
3621 bfd_vma *p_veneer_i)
3622{
3623 uint32_t insn_1 = bfd_getl32 (contents + i);
3624
3625 if (!_bfd_aarch64_adrp_p (insn_1))
3626 return FALSE;
3627
3628 if (span_end < i + 12)
3629 return FALSE;
3630
3631 uint32_t insn_2 = bfd_getl32 (contents + i + 4);
3632 uint32_t insn_3 = bfd_getl32 (contents + i + 8);
3633
3634 if ((vma & 0xfff) != 0xff8 && (vma & 0xfff) != 0xffc)
3635 return FALSE;
3636
3637 if (_bfd_aarch64_erratum_843419_sequence_p (insn_1, insn_2, insn_3))
3638 {
3639 *p_veneer_i = i + 8;
3640 return TRUE;
3641 }
3642
3643 if (span_end < i + 16)
3644 return FALSE;
3645
3646 uint32_t insn_4 = bfd_getl32 (contents + i + 12);
3647
3648 if (_bfd_aarch64_erratum_843419_sequence_p (insn_1, insn_2, insn_4))
3649 {
3650 *p_veneer_i = i + 12;
3651 return TRUE;
3652 }
3653
3654 return FALSE;
3655}
3656
3657
13f622ec
MS		 3658/* Resize all stub sections. */
3659
3660static void
3661_bfd_aarch64_resize_stubs (struct elf_aarch64_link_hash_table *htab)
3662{
3663 asection *section;
3664
3665 /* OK, we've added some stubs. Find out the new size of the
3666 stub sections. */
3667 for (section = htab->stub_bfd->sections;
3668 section != NULL; section = section->next)
3669 {
3670 /* Ignore non-stub sections. */
3671 if (!strstr (section->name, STUB_SUFFIX))
3672 continue;
3673 section->size = 0;
3674 }
3675
3676 bfd_hash_traverse (&htab->stub_hash_table, aarch64_size_one_stub, htab);
13f622ec 3677
61865519
MS		 3678 for (section = htab->stub_bfd->sections;
3679 section != NULL; section = section->next)
3680 {
3681 if (!strstr (section->name, STUB_SUFFIX))
3682 continue;
3683
3684 if (section->size)
3685 section->size += 4;
4106101c
MS		 3686
3687 /* Ensure all stub sections have a size which is a multiple of
3688 4096. This is important in order to ensure that the insertion
3689 of stub sections does not in itself move existing code around
3690 in such a way that new errata sequences are created. */
3691 if (htab->fix_erratum_843419)
3692 if (section->size)
3693 section->size = BFD_ALIGN (section->size, 0x1000);
3694 }
3695}
3696
3697
3698/* Construct an erratum 843419 workaround stub name.
3699 */
3700
3701static char *
3702_bfd_aarch64_erratum_843419_stub_name (asection *input_section,
3703 bfd_vma offset)
3704{
3705 const bfd_size_type len = 8 + 4 + 1 + 8 + 1 + 16 + 1;
3706 char *stub_name = bfd_malloc (len);
3707
3708 if (stub_name != NULL)
3709 snprintf (stub_name, len, "e843419@%04x_%08x_%" BFD_VMA_FMT "x",
3710 input_section->owner->id,
3711 input_section->id,
3712 offset);
3713 return stub_name;
3714}
3715
3716/* Build a stub_entry structure describing an 843419 fixup.
3717
3718 The stub_entry constructed is populated with the bit pattern INSN
3719 of the instruction located at OFFSET within input SECTION.
3720
3721 Returns TRUE on success. */
3722
3723static bfd_boolean
3724_bfd_aarch64_erratum_843419_fixup (uint32_t insn,
3725 bfd_vma adrp_offset,
3726 bfd_vma ldst_offset,
3727 asection *section,
3728 struct bfd_link_info *info)
3729{
3730 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
3731 char *stub_name;
3732 struct elf_aarch64_stub_hash_entry *stub_entry;
3733
3734 stub_name = _bfd_aarch64_erratum_843419_stub_name (section, ldst_offset);
3735 stub_entry = aarch64_stub_hash_lookup (&htab->stub_hash_table, stub_name,
3736 FALSE, FALSE);
3737 if (stub_entry)
3738 {
3739 free (stub_name);
3740 return TRUE;
3741 }
3742
3743 /* We always place an 843419 workaround veneer in the stub section
3744 attached to the input section in which an erratum sequence has
3745 been found. This ensures that later in the link process (in
3746 elfNN_aarch64_write_section) when we copy the veneered
3747 instruction from the input section into the stub section the
3748 copied instruction will have had any relocations applied to it.
3749 If we placed workaround veneers in any other stub section then we
3750 could not assume that all relocations have been processed on the
3751 corresponding input section at the point we output the stub
3752 section.
3753 */
3754
3755 stub_entry = _bfd_aarch64_add_stub_entry_after (stub_name, section, htab);
3756 if (stub_entry == NULL)
3757 {
3758 free (stub_name);
3759 return FALSE;
3760 }
3761
3762 stub_entry->adrp_offset = adrp_offset;
3763 stub_entry->target_value = ldst_offset;
3764 stub_entry->target_section = section;
3765 stub_entry->stub_type = aarch64_stub_erratum_843419_veneer;
3766 stub_entry->veneered_insn = insn;
3767 stub_entry->output_name = stub_name;
3768
3769 return TRUE;
3770}
3771
3772
3773/* Scan an input section looking for the signature of erratum 843419.
3774
3775 Scans input SECTION in INPUT_BFD looking for erratum 843419
3776 signatures, for each signature found a stub_entry is created
3777 describing the location of the erratum for subsequent fixup.
3778
3779 Return TRUE on successful scan, FALSE on failure to scan.
3780 */
3781
3782static bfd_boolean
3783_bfd_aarch64_erratum_843419_scan (bfd *input_bfd, asection *section,
3784 struct bfd_link_info *info)
3785{
3786 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
3787
3788 if (htab == NULL)
3789 return TRUE;
3790
3791 if (elf_section_type (section) != SHT_PROGBITS
3792 || (elf_section_flags (section) & SHF_EXECINSTR) == 0
3793 || (section->flags & SEC_EXCLUDE) != 0
3794 || (section->sec_info_type == SEC_INFO_TYPE_JUST_SYMS)
3795 || (section->output_section == bfd_abs_section_ptr))
3796 return TRUE;
3797
3798 do
3799 {
3800 bfd_byte *contents = NULL;
3801 struct _aarch64_elf_section_data *sec_data;
3802 unsigned int span;
3803
3804 if (elf_section_data (section)->this_hdr.contents != NULL)
3805 contents = elf_section_data (section)->this_hdr.contents;
3806 else if (! bfd_malloc_and_get_section (input_bfd, section, &contents))
3807 return FALSE;
3808
3809 sec_data = elf_aarch64_section_data (section);
3810
3811 qsort (sec_data->map, sec_data->mapcount,
3812 sizeof (elf_aarch64_section_map), elf_aarch64_compare_mapping);
3813
3814 for (span = 0; span < sec_data->mapcount; span++)
3815 {
3816 unsigned int span_start = sec_data->map[span].vma;
3817 unsigned int span_end = ((span == sec_data->mapcount - 1)
3818 ? sec_data->map[0].vma + section->size
3819 : sec_data->map[span + 1].vma);
3820 unsigned int i;
3821 char span_type = sec_data->map[span].type;
3822
3823 if (span_type == 'd')
3824 continue;
3825
3826 for (i = span_start; i + 8 < span_end; i += 4)
3827 {
3828 bfd_vma vma = (section->output_section->vma
3829 + section->output_offset
3830 + i);
3831 bfd_vma veneer_i;
3832
3833 if (_bfd_aarch64_erratum_843419_p
3834 (contents, vma, i, span_end, &veneer_i))
3835 {
3836 uint32_t insn = bfd_getl32 (contents + veneer_i);
3837
3838 if (!_bfd_aarch64_erratum_843419_fixup (insn, i, veneer_i,
3839 section, info))
3840 return FALSE;
3841 }
3842 }
3843 }
3844
3845 if (elf_section_data (section)->this_hdr.contents == NULL)
3846 free (contents);
61865519 3847 }
4106101c
MS		 3848 while (0);
3849
3850 return TRUE;
61865519 3851}
13f622ec 3852
4106101c 3853
a06ea964
NC		 3854/* Determine and set the size of the stub section for a final link.
3855
3856 The basic idea here is to examine all the relocations looking for
3857 PC-relative calls to a target that is unreachable with a "bl"
3858 instruction. */
3859
3860bfd_boolean
cec5225b 3861elfNN_aarch64_size_stubs (bfd *output_bfd,
a06ea964
NC		 3862 bfd *stub_bfd,
3863 struct bfd_link_info *info,
3864 bfd_signed_vma group_size,
3865 asection * (*add_stub_section) (const char *,
3866 asection *),
3867 void (*layout_sections_again) (void))
3868{
3869 bfd_size_type stub_group_size;
3870 bfd_boolean stubs_always_before_branch;
5421cc6e 3871 bfd_boolean stub_changed = FALSE;
cec5225b 3872 struct elf_aarch64_link_hash_table *htab = elf_aarch64_hash_table (info);
68fcca92 3873 unsigned int num_erratum_835769_fixes = 0;
a06ea964
NC		 3874
3875 /* Propagate mach to stub bfd, because it may not have been
3876 finalized when we created stub_bfd. */
3877 bfd_set_arch_mach (stub_bfd, bfd_get_arch (output_bfd),
3878 bfd_get_mach (output_bfd));
3879
3880 /* Stash our params away. */
3881 htab->stub_bfd = stub_bfd;
3882 htab->add_stub_section = add_stub_section;
3883 htab->layout_sections_again = layout_sections_again;
3884 stubs_always_before_branch = group_size < 0;
3885 if (group_size < 0)
3886 stub_group_size = -group_size;
3887 else
3888 stub_group_size = group_size;
3889
3890 if (stub_group_size == 1)
3891 {
3892 /* Default values. */
b9eead84 3893 /* AArch64 branch range is +-128MB. The value used is 1MB less. */
a06ea964
NC		 3894 stub_group_size = 127 * 1024 * 1024;
3895 }
3896
3897 group_sections (htab, stub_group_size, stubs_always_before_branch);
3898
4106101c
MS		 3899 (*htab->layout_sections_again) ();
3900
5421cc6e
MS		 3901 if (htab->fix_erratum_835769)
3902 {
3903 bfd *input_bfd;
3904
3905 for (input_bfd = info->input_bfds;
3906 input_bfd != NULL; input_bfd = input_bfd->link.next)
3907 if (!_bfd_aarch64_erratum_835769_scan (input_bfd, info,
3908 &num_erratum_835769_fixes))
3909 return FALSE;
3910
4106101c
MS		 3911 _bfd_aarch64_resize_stubs (htab);
3912 (*htab->layout_sections_again) ();
3913 }
3914
3915 if (htab->fix_erratum_843419)
3916 {
3917 bfd *input_bfd;
3918
3919 for (input_bfd = info->input_bfds;
3920 input_bfd != NULL;
3921 input_bfd = input_bfd->link.next)
3922 {
3923 asection *section;
3924
3925 for (section = input_bfd->sections;
3926 section != NULL;
3927 section = section->next)
3928 if (!_bfd_aarch64_erratum_843419_scan (input_bfd, section, info))
3929 return FALSE;
3930 }
3931
3932 _bfd_aarch64_resize_stubs (htab);
3933 (*htab->layout_sections_again) ();
5421cc6e
MS		 3934 }
3935
a06ea964
NC		 3936 while (1)
3937 {
3938 bfd *input_bfd;
a06ea964 3939
9b9971aa
MS		 3940 for (input_bfd = info->input_bfds;
3941 input_bfd != NULL; input_bfd = input_bfd->link.next)
a06ea964
NC		 3942 {
3943 Elf_Internal_Shdr *symtab_hdr;
3944 asection *section;
3945 Elf_Internal_Sym *local_syms = NULL;
3946
3947 /* We'll need the symbol table in a second. */
3948 symtab_hdr = &elf_tdata (input_bfd)->symtab_hdr;
3949 if (symtab_hdr->sh_info == 0)
3950 continue;
3951
3952 /* Walk over each section attached to the input bfd. */
3953 for (section = input_bfd->sections;
3954 section != NULL; section = section->next)
3955 {
3956 Elf_Internal_Rela *internal_relocs, *irelaend, *irela;
3957
3958 /* If there aren't any relocs, then there's nothing more
3959 to do. */
3960 if ((section->flags & SEC_RELOC) == 0
3961 || section->reloc_count == 0
3962 || (section->flags & SEC_CODE) == 0)
3963 continue;
3964
3965 /* If this section is a link-once section that will be
3966 discarded, then don't create any stubs. */
3967 if (section->output_section == NULL
3968 || section->output_section->owner != output_bfd)
3969 continue;
3970
3971 /* Get the relocs. */
3972 internal_relocs
3973 = _bfd_elf_link_read_relocs (input_bfd, section, NULL,
3974 NULL, info->keep_memory);
3975 if (internal_relocs == NULL)
3976 goto error_ret_free_local;
3977
3978 /* Now examine each relocation. */
3979 irela = internal_relocs;
3980 irelaend = irela + section->reloc_count;
3981 for (; irela < irelaend; irela++)
3982 {
3983 unsigned int r_type, r_indx;
cec5225b
YZ		 3984 enum elf_aarch64_stub_type stub_type;
3985 struct elf_aarch64_stub_hash_entry *stub_entry;
a06ea964
NC		 3986 asection *sym_sec;
3987 bfd_vma sym_value;
3988 bfd_vma destination;
cec5225b 3989 struct elf_aarch64_link_hash_entry *hash;
a06ea964
NC		 3990 const char *sym_name;
3991 char *stub_name;
3992 const asection *id_sec;
3993 unsigned char st_type;
3994 bfd_size_type len;
3995
cec5225b
YZ		 3996 r_type = ELFNN_R_TYPE (irela->r_info);
3997 r_indx = ELFNN_R_SYM (irela->r_info);
a06ea964
NC		 3998
3999 if (r_type >= (unsigned int) R_AARCH64_end)
4000 {
4001 bfd_set_error (bfd_error_bad_value);
4002 error_ret_free_internal:
4003 if (elf_section_data (section)->relocs == NULL)
4004 free (internal_relocs);
4005 goto error_ret_free_local;
4006 }
4007
4008 /* Only look for stubs on unconditional branch and
4009 branch and link instructions. */
a6bb11b2
YZ		 4010 if (r_type != (unsigned int) AARCH64_R (CALL26)
4011 && r_type != (unsigned int) AARCH64_R (JUMP26))
a06ea964
NC		 4012 continue;
4013
4014 /* Now determine the call target, its name, value,
4015 section. */
4016 sym_sec = NULL;
4017 sym_value = 0;
4018 destination = 0;
4019 hash = NULL;
4020 sym_name = NULL;
4021 if (r_indx < symtab_hdr->sh_info)
4022 {
4023 /* It's a local symbol. */
4024 Elf_Internal_Sym *sym;
4025 Elf_Internal_Shdr *hdr;
4026
4027 if (local_syms == NULL)
4028 {
4029 local_syms
4030 = (Elf_Internal_Sym *) symtab_hdr->contents;
4031 if (local_syms == NULL)
4032 local_syms
4033 = bfd_elf_get_elf_syms (input_bfd, symtab_hdr,
4034 symtab_hdr->sh_info, 0,
4035 NULL, NULL, NULL);
4036 if (local_syms == NULL)
4037 goto error_ret_free_internal;
4038 }
4039
4040 sym = local_syms + r_indx;
4041 hdr = elf_elfsections (input_bfd)[sym->st_shndx];
4042 sym_sec = hdr->bfd_section;
4043 if (!sym_sec)
4044 /* This is an undefined symbol. It can never
4045 be resolved. */
4046 continue;
4047
4048 if (ELF_ST_TYPE (sym->st_info) != STT_SECTION)
4049 sym_value = sym->st_value;
4050 destination = (sym_value + irela->r_addend
4051 + sym_sec->output_offset
4052 + sym_sec->output_section->vma);
4053 st_type = ELF_ST_TYPE (sym->st_info);
4054 sym_name
4055 = bfd_elf_string_from_elf_section (input_bfd,
4056 symtab_hdr->sh_link,
4057 sym->st_name);
4058 }
4059 else
4060 {
4061 int e_indx;
4062
4063 e_indx = r_indx - symtab_hdr->sh_info;
cec5225b 4064 hash = ((struct elf_aarch64_link_hash_entry *)
a06ea964
NC		 4065 elf_sym_hashes (input_bfd)[e_indx]);
4066
4067 while (hash->root.root.type == bfd_link_hash_indirect
4068 || hash->root.root.type == bfd_link_hash_warning)
cec5225b 4069 hash = ((struct elf_aarch64_link_hash_entry *)
a06ea964
NC		 4070 hash->root.root.u.i.link);
4071
4072 if (hash->root.root.type == bfd_link_hash_defined
4073 || hash->root.root.type == bfd_link_hash_defweak)
4074 {
cec5225b
YZ		 4075 struct elf_aarch64_link_hash_table *globals =
4076 elf_aarch64_hash_table (info);
a06ea964
NC		 4077 sym_sec = hash->root.root.u.def.section;
4078 sym_value = hash->root.root.u.def.value;
4079 /* For a destination in a shared library,
4080 use the PLT stub as target address to
4081 decide whether a branch stub is
4082 needed. */
4083 if (globals->root.splt != NULL && hash != NULL
4084 && hash->root.plt.offset != (bfd_vma) - 1)
4085 {
4086 sym_sec = globals->root.splt;
4087 sym_value = hash->root.plt.offset;
4088 if (sym_sec->output_section != NULL)
4089 destination = (sym_value
4090 + sym_sec->output_offset
4091 +
4092 sym_sec->output_section->vma);
4093 }
4094 else if (sym_sec->output_section != NULL)
4095 destination = (sym_value + irela->r_addend
4096 + sym_sec->output_offset
4097 + sym_sec->output_section->vma);
4098 }
4099 else if (hash->root.root.type == bfd_link_hash_undefined
4100 || (hash->root.root.type
4101 == bfd_link_hash_undefweak))
4102 {
4103 /* For a shared library, use the PLT stub as
4104 target address to decide whether a long
4105 branch stub is needed.
4106 For absolute code, they cannot be handled. */
cec5225b
YZ		 4107 struct elf_aarch64_link_hash_table *globals =
4108 elf_aarch64_hash_table (info);
a06ea964
NC		 4109
4110 if (globals->root.splt != NULL && hash != NULL
4111 && hash->root.plt.offset != (bfd_vma) - 1)
4112 {
4113 sym_sec = globals->root.splt;
4114 sym_value = hash->root.plt.offset;
4115 if (sym_sec->output_section != NULL)
4116 destination = (sym_value
4117 + sym_sec->output_offset
4118 +
4119 sym_sec->output_section->vma);
4120 }
4121 else
4122 continue;
4123 }
4124 else
4125 {
4126 bfd_set_error (bfd_error_bad_value);
4127 goto error_ret_free_internal;
4128 }
4129 st_type = ELF_ST_TYPE (hash->root.type);
4130 sym_name = hash->root.root.root.string;
4131 }
4132
4133 /* Determine what (if any) linker stub is needed. */
9a228467
JW		 4134 stub_type = aarch64_type_of_stub (section, irela, sym_sec,
4135 st_type, destination);
a06ea964
NC		 4136 if (stub_type == aarch64_stub_none)
4137 continue;
4138
4139 /* Support for grouping stub sections. */
4140 id_sec = htab->stub_group[section->id].link_sec;
4141
4142 /* Get the name of this stub. */
cec5225b 4143 stub_name = elfNN_aarch64_stub_name (id_sec, sym_sec, hash,
a06ea964
NC		 4144 irela);
4145 if (!stub_name)
4146 goto error_ret_free_internal;
4147
4148 stub_entry =
4149 aarch64_stub_hash_lookup (&htab->stub_hash_table,
4150 stub_name, FALSE, FALSE);
4151 if (stub_entry != NULL)
4152 {
4153 /* The proper stub has already been created. */
4154 free (stub_name);
4155 continue;
4156 }
4157
ef857521
MS		 4158 stub_entry = _bfd_aarch64_add_stub_entry_in_group
4159 (stub_name, section, htab);
a06ea964
NC		 4160 if (stub_entry == NULL)
4161 {
4162 free (stub_name);
4163 goto error_ret_free_internal;
4164 }
4165
2f340668 4166 stub_entry->target_value = sym_value + irela->r_addend;
a06ea964
NC		 4167 stub_entry->target_section = sym_sec;
4168 stub_entry->stub_type = stub_type;
4169 stub_entry->h = hash;
4170 stub_entry->st_type = st_type;
4171
4172 if (sym_name == NULL)
4173 sym_name = "unnamed";
4174 len = sizeof (STUB_ENTRY_NAME) + strlen (sym_name);
4175 stub_entry->output_name = bfd_alloc (htab->stub_bfd, len);
4176 if (stub_entry->output_name == NULL)
4177 {
4178 free (stub_name);
4179 goto error_ret_free_internal;
4180 }
4181
4182 snprintf (stub_entry->output_name, len, STUB_ENTRY_NAME,
4183 sym_name);
4184
4185 stub_changed = TRUE;
4186 }
4187
4188 /* We're done with the internal relocs, free them. */
4189 if (elf_section_data (section)->relocs == NULL)
4190 free (internal_relocs);
4191 }
4192 }
4193
4194 if (!stub_changed)
4195 break;
4196
13f622ec 4197 _bfd_aarch64_resize_stubs (htab);
a06ea964
NC		 4198
4199 /* Ask the linker to do its stuff. */
4200 (*htab->layout_sections_again) ();
4201 stub_changed = FALSE;
4202 }
4203
4204 return TRUE;
4205
4206error_ret_free_local:
4207 return FALSE;
4208}
4209
4210/* Build all the stubs associated with the current output file. The
4211 stubs are kept in a hash table attached to the main linker hash
4212 table. We also set up the .plt entries for statically linked PIC
4213 functions here. This function is called via aarch64_elf_finish in the
4214 linker. */
4215
4216bfd_boolean
cec5225b 4217elfNN_aarch64_build_stubs (struct bfd_link_info *info)
a06ea964
NC		 4218{
4219 asection *stub_sec;
4220 struct bfd_hash_table *table;
cec5225b 4221 struct elf_aarch64_link_hash_table *htab;
a06ea964 4222
cec5225b 4223 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 4224
4225 for (stub_sec = htab->stub_bfd->sections;
4226 stub_sec != NULL; stub_sec = stub_sec->next)
4227 {
4228 bfd_size_type size;
4229
4230 /* Ignore non-stub sections. */
4231 if (!strstr (stub_sec->name, STUB_SUFFIX))
4232 continue;
4233
4234 /* Allocate memory to hold the linker stubs. */
4235 size = stub_sec->size;
4236 stub_sec->contents = bfd_zalloc (htab->stub_bfd, size);
4237 if (stub_sec->contents == NULL && size != 0)
4238 return FALSE;
4239 stub_sec->size = 0;
61865519
MS		 4240
4241 bfd_putl32 (0x14000000 | (size >> 2), stub_sec->contents);
4242 stub_sec->size += 4;
a06ea964
NC		 4243 }
4244
4245 /* Build the stubs as directed by the stub hash table. */
4246 table = &htab->stub_hash_table;
4247 bfd_hash_traverse (table, aarch64_build_one_stub, info);
4248
4249 return TRUE;
4250}
4251
4252
4253/* Add an entry to the code/data map for section SEC. */
4254
4255static void
cec5225b 4256elfNN_aarch64_section_map_add (asection *sec, char type, bfd_vma vma)
a06ea964
NC		 4257{
4258 struct _aarch64_elf_section_data *sec_data =
cec5225b 4259 elf_aarch64_section_data (sec);
a06ea964
NC		 4260 unsigned int newidx;
4261
4262 if (sec_data->map == NULL)
4263 {
cec5225b 4264 sec_data->map = bfd_malloc (sizeof (elf_aarch64_section_map));
a06ea964
NC		 4265 sec_data->mapcount = 0;
4266 sec_data->mapsize = 1;
4267 }
4268
4269 newidx = sec_data->mapcount++;
4270
4271 if (sec_data->mapcount > sec_data->mapsize)
4272 {
4273 sec_data->mapsize *= 2;
4274 sec_data->map = bfd_realloc_or_free
cec5225b 4275 (sec_data->map, sec_data->mapsize * sizeof (elf_aarch64_section_map));
a06ea964
NC		 4276 }
4277
4278 if (sec_data->map)
4279 {
4280 sec_data->map[newidx].vma = vma;
4281 sec_data->map[newidx].type = type;
4282 }
4283}
4284
4285
4286/* Initialise maps of insn/data for input BFDs. */
4287void
cec5225b 4288bfd_elfNN_aarch64_init_maps (bfd *abfd)
a06ea964
NC		 4289{
4290 Elf_Internal_Sym *isymbuf;
4291 Elf_Internal_Shdr *hdr;
4292 unsigned int i, localsyms;
4293
4294 /* Make sure that we are dealing with an AArch64 elf binary. */
4295 if (!is_aarch64_elf (abfd))
4296 return;
4297
4298 if ((abfd->flags & DYNAMIC) != 0)
68fcca92 4299 return;
a06ea964
NC		 4300
4301 hdr = &elf_symtab_hdr (abfd);
4302 localsyms = hdr->sh_info;
4303
4304 /* Obtain a buffer full of symbols for this BFD. The hdr->sh_info field
4305 should contain the number of local symbols, which should come before any
4306 global symbols. Mapping symbols are always local. */
4307 isymbuf = bfd_elf_get_elf_syms (abfd, hdr, localsyms, 0, NULL, NULL, NULL);
4308
4309 /* No internal symbols read? Skip this BFD. */
4310 if (isymbuf == NULL)
4311 return;
4312
4313 for (i = 0; i < localsyms; i++)
4314 {
4315 Elf_Internal_Sym *isym = &isymbuf[i];
4316 asection *sec = bfd_section_from_elf_index (abfd, isym->st_shndx);
4317 const char *name;
4318
4319 if (sec != NULL && ELF_ST_BIND (isym->st_info) == STB_LOCAL)
4320 {
4321 name = bfd_elf_string_from_elf_section (abfd,
4322 hdr->sh_link,
4323 isym->st_name);
4324
4325 if (bfd_is_aarch64_special_symbol_name
4326 (name, BFD_AARCH64_SPECIAL_SYM_TYPE_MAP))
cec5225b 4327 elfNN_aarch64_section_map_add (sec, name[1], isym->st_value);
a06ea964
NC		 4328 }
4329 }
4330}
4331
4332/* Set option values needed during linking. */
4333void
cec5225b 4334bfd_elfNN_aarch64_set_options (struct bfd *output_bfd,
a06ea964
NC		 4335 struct bfd_link_info *link_info,
4336 int no_enum_warn,
68fcca92 4337 int no_wchar_warn, int pic_veneer,
4106101c 4338 int fix_erratum_835769,
1f56df9d
JW		 4339 int fix_erratum_843419,
4340 int no_apply_dynamic_relocs)
a06ea964 4341{
cec5225b 4342 struct elf_aarch64_link_hash_table *globals;
a06ea964 4343
cec5225b 4344 globals = elf_aarch64_hash_table (link_info);
a06ea964 4345 globals->pic_veneer = pic_veneer;
68fcca92 4346 globals->fix_erratum_835769 = fix_erratum_835769;
4106101c
MS		 4347 globals->fix_erratum_843419 = fix_erratum_843419;
4348 globals->fix_erratum_843419_adr = TRUE;
1f56df9d 4349 globals->no_apply_dynamic_relocs = no_apply_dynamic_relocs;
a06ea964
NC		 4350
4351 BFD_ASSERT (is_aarch64_elf (output_bfd));
4352 elf_aarch64_tdata (output_bfd)->no_enum_size_warning = no_enum_warn;
4353 elf_aarch64_tdata (output_bfd)->no_wchar_size_warning = no_wchar_warn;
4354}
4355
a06ea964
NC		 4356static bfd_vma
4357aarch64_calculate_got_entry_vma (struct elf_link_hash_entry *h,
cec5225b 4358 struct elf_aarch64_link_hash_table
a06ea964
NC		 4359 *globals, struct bfd_link_info *info,
4360 bfd_vma value, bfd *output_bfd,
4361 bfd_boolean *unresolved_reloc_p)
4362{
4363 bfd_vma off = (bfd_vma) - 1;
4364 asection *basegot = globals->root.sgot;
4365 bfd_boolean dyn = globals->root.dynamic_sections_created;
4366
4367 if (h != NULL)
4368 {
a6bb11b2 4369 BFD_ASSERT (basegot != NULL);
a06ea964
NC		 4370 off = h->got.offset;
4371 BFD_ASSERT (off != (bfd_vma) - 1);
0e1862bb
L		 4372 if (!WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, bfd_link_pic (info), h)
4373 || (bfd_link_pic (info)
a06ea964
NC		 4374 && SYMBOL_REFERENCES_LOCAL (info, h))
4375 || (ELF_ST_VISIBILITY (h->other)
4376 && h->root.type == bfd_link_hash_undefweak))
4377 {
4378 /* This is actually a static link, or it is a -Bsymbolic link
4379 and the symbol is defined locally. We must initialize this
4380 entry in the global offset table. Since the offset must
a6bb11b2
YZ		 4381 always be a multiple of 8 (4 in the case of ILP32), we use
4382 the least significant bit to record whether we have
4383 initialized it already.
a06ea964
NC		 4384 When doing a dynamic link, we create a .rel(a).got relocation
4385 entry to initialize the value. This is done in the
4386 finish_dynamic_symbol routine. */
4387 if ((off & 1) != 0)
4388 off &= ~1;
4389 else
4390 {
cec5225b 4391 bfd_put_NN (output_bfd, value, basegot->contents + off);
a06ea964
NC		 4392 h->got.offset |= 1;
4393 }
4394 }
4395 else
4396 *unresolved_reloc_p = FALSE;
4397
4398 off = off + basegot->output_section->vma + basegot->output_offset;
4399 }
4400
4401 return off;
4402}
4403
4404/* Change R_TYPE to a more efficient access model where possible,
4405 return the new reloc type. */
4406
a6bb11b2
YZ		 4407static bfd_reloc_code_real_type
4408aarch64_tls_transition_without_check (bfd_reloc_code_real_type r_type,
a06ea964
NC		 4409 struct elf_link_hash_entry *h)
4410{
4411 bfd_boolean is_local = h == NULL;
a6bb11b2 4412
a06ea964
NC		 4413 switch (r_type)
4414 {
a6bb11b2 4415 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
ce336788 4416 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
a6bb11b2
YZ		 4417 return (is_local
4418 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1
4419 : BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21);
4420
389b8029
MS		 4421 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
4422 return (is_local
4423 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC
4424 : r_type);
4425
1ada945d
MS		 4426 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
4427 return (is_local
4428 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1
4429 : BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19);
4430
0484b454
RL		 4431 case BFD_RELOC_AARCH64_TLSDESC_LDR:
4432 return (is_local
4433 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC
4434 : BFD_RELOC_AARCH64_NONE);
4435
4436 case BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC:
4437 return (is_local
4438 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC
4439 : BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC);
4440
4441 case BFD_RELOC_AARCH64_TLSDESC_OFF_G1:
4442 return (is_local
4443 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2
4444 : BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1);
4445
a6bb11b2 4446 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
ce336788 4447 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a6bb11b2
YZ		 4448 return (is_local
4449 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC
4450 : BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC);
4451
4452 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
4453 return is_local ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1 : r_type;
4454
4455 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
4456 return is_local ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC : r_type;
4457
043bf05a
MS		 4458 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
4459 return r_type;
4460
3c12b054
MS		 4461 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
4462 return (is_local
4463 ? BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12
4464 : BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19);
4465
0484b454 4466 case BFD_RELOC_AARCH64_TLSDESC_ADD:
a6bb11b2
YZ		 4467 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
4468 case BFD_RELOC_AARCH64_TLSDESC_CALL:
a06ea964 4469 /* Instructions with these relocations will become NOPs. */
a6bb11b2
YZ		 4470 return BFD_RELOC_AARCH64_NONE;
4471
259364ad
JW		 4472 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
4473 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
4474 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
4475 return is_local ? BFD_RELOC_AARCH64_NONE : r_type;
4476
ac734732
RL		 4477#if ARCH_SIZE == 64
4478 case BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC:
4479 return is_local
4480 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC
4481 : BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC;
4482
4483 case BFD_RELOC_AARCH64_TLSGD_MOVW_G1:
4484 return is_local
4485 ? BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2
4486 : BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1;
4487#endif
4488
a6bb11b2
YZ		 4489 default:
4490 break;
a06ea964
NC		 4491 }
4492
4493 return r_type;
4494}
4495
4496static unsigned int
a6bb11b2 4497aarch64_reloc_got_type (bfd_reloc_code_real_type r_type)
a06ea964
NC		 4498{
4499 switch (r_type)
4500 {
a6bb11b2
YZ		 4501 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
4502 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 4503 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
ce336788 4504 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
a2e1db00 4505 case BFD_RELOC_AARCH64_LD64_GOTOFF_LO15:
99ad26cb 4506 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
ce336788 4507 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
dc8008f5 4508 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G0_NC:
74a1bfe1 4509 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G1:
a06ea964
NC		 4510 return GOT_NORMAL;
4511
ce336788 4512 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a6bb11b2 4513 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 4514 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
7ba7cfe4 4515 case BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC:
94facae3 4516 case BFD_RELOC_AARCH64_TLSGD_MOVW_G1:
73f925cc 4517 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 4518 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 4519 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a06ea964
NC		 4520 return GOT_TLS_GD;
4521
0484b454 4522 case BFD_RELOC_AARCH64_TLSDESC_ADD:
a6bb11b2
YZ		 4523 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
4524 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 4525 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
a6bb11b2 4526 case BFD_RELOC_AARCH64_TLSDESC_CALL:
a6bb11b2 4527 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
ce336788 4528 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
1ada945d 4529 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
0484b454
RL		 4530 case BFD_RELOC_AARCH64_TLSDESC_LDR:
4531 case BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC:
4532 case BFD_RELOC_AARCH64_TLSDESC_OFF_G1:
a06ea964
NC		 4533 return GOT_TLSDESC_GD;
4534
a6bb11b2 4535 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a6bb11b2 4536 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
ce336788 4537 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
043bf05a 4538 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
3b957e5b
RL		 4539 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC:
4540 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1:
a06ea964
NC		 4541 return GOT_TLS_IE;
4542
a6bb11b2
YZ		 4543 default:
4544 break;
a06ea964
NC		 4545 }
4546 return GOT_UNKNOWN;
4547}
4548
4549static bfd_boolean
4550aarch64_can_relax_tls (bfd *input_bfd,
4551 struct bfd_link_info *info,
a6bb11b2 4552 bfd_reloc_code_real_type r_type,
a06ea964
NC		 4553 struct elf_link_hash_entry *h,
4554 unsigned long r_symndx)
4555{
4556 unsigned int symbol_got_type;
4557 unsigned int reloc_got_type;
4558
9331eea1 4559 if (! IS_AARCH64_TLS_RELAX_RELOC (r_type))
a06ea964
NC		 4560 return FALSE;
4561
cec5225b 4562 symbol_got_type = elfNN_aarch64_symbol_got_type (h, input_bfd, r_symndx);
a06ea964
NC		 4563 reloc_got_type = aarch64_reloc_got_type (r_type);
4564
4565 if (symbol_got_type == GOT_TLS_IE && GOT_TLS_GD_ANY_P (reloc_got_type))
4566 return TRUE;
4567
0e1862bb 4568 if (bfd_link_pic (info))
a06ea964
NC		 4569 return FALSE;
4570
4571 if (h && h->root.type == bfd_link_hash_undefweak)
4572 return FALSE;
4573
4574 return TRUE;
4575}
4576
a6bb11b2
YZ		 4577/* Given the relocation code R_TYPE, return the relaxed bfd reloc
4578 enumerator. */
4579
4580static bfd_reloc_code_real_type
a06ea964
NC		 4581aarch64_tls_transition (bfd *input_bfd,
4582 struct bfd_link_info *info,
4583 unsigned int r_type,
4584 struct elf_link_hash_entry *h,
4585 unsigned long r_symndx)
4586{
a6bb11b2
YZ		 4587 bfd_reloc_code_real_type bfd_r_type
4588 = elfNN_aarch64_bfd_reloc_from_type (r_type);
a06ea964 4589
a6bb11b2
YZ		 4590 if (! aarch64_can_relax_tls (input_bfd, info, bfd_r_type, h, r_symndx))
4591 return bfd_r_type;
4592
4593 return aarch64_tls_transition_without_check (bfd_r_type, h);
a06ea964
NC		 4594}
4595
4596/* Return the base VMA address which should be subtracted from real addresses
a6bb11b2 4597 when resolving R_AARCH64_TLS_DTPREL relocation. */
a06ea964
NC		 4598
4599static bfd_vma
4600dtpoff_base (struct bfd_link_info *info)
4601{
4602 /* If tls_sec is NULL, we should have signalled an error already. */
4603 BFD_ASSERT (elf_hash_table (info)->tls_sec != NULL);
4604 return elf_hash_table (info)->tls_sec->vma;
4605}
4606
a06ea964
NC		 4607/* Return the base VMA address which should be subtracted from real addresses
4608 when resolving R_AARCH64_TLS_GOTTPREL64 relocations. */
4609
4610static bfd_vma
4611tpoff_base (struct bfd_link_info *info)
4612{
4613 struct elf_link_hash_table *htab = elf_hash_table (info);
4614
4615 /* If tls_sec is NULL, we should have signalled an error already. */
ac21917f 4616 BFD_ASSERT (htab->tls_sec != NULL);
a06ea964
NC		 4617
4618 bfd_vma base = align_power ((bfd_vma) TCB_SIZE,
4619 htab->tls_sec->alignment_power);
4620 return htab->tls_sec->vma - base;
4621}
4622
4623static bfd_vma *
4624symbol_got_offset_ref (bfd *input_bfd, struct elf_link_hash_entry *h,
4625 unsigned long r_symndx)
4626{
4627 /* Calculate the address of the GOT entry for symbol
4628 referred to in h. */
4629 if (h != NULL)
4630 return &h->got.offset;
4631 else
4632 {
4633 /* local symbol */
4634 struct elf_aarch64_local_symbol *l;
4635
cec5225b 4636 l = elf_aarch64_locals (input_bfd);
a06ea964
NC		 4637 return &l[r_symndx].got_offset;
4638 }
4639}
4640
4641static void
4642symbol_got_offset_mark (bfd *input_bfd, struct elf_link_hash_entry *h,
4643 unsigned long r_symndx)
4644{
4645 bfd_vma *p;
4646 p = symbol_got_offset_ref (input_bfd, h, r_symndx);
4647 *p |= 1;
4648}
4649
4650static int
4651symbol_got_offset_mark_p (bfd *input_bfd, struct elf_link_hash_entry *h,
4652 unsigned long r_symndx)
4653{
4654 bfd_vma value;
4655 value = * symbol_got_offset_ref (input_bfd, h, r_symndx);
4656 return value & 1;
4657}
4658
4659static bfd_vma
4660symbol_got_offset (bfd *input_bfd, struct elf_link_hash_entry *h,
4661 unsigned long r_symndx)
4662{
4663 bfd_vma value;
4664 value = * symbol_got_offset_ref (input_bfd, h, r_symndx);
4665 value &= ~1;
4666 return value;
4667}
4668
4669static bfd_vma *
4670symbol_tlsdesc_got_offset_ref (bfd *input_bfd, struct elf_link_hash_entry *h,
4671 unsigned long r_symndx)
4672{
4673 /* Calculate the address of the GOT entry for symbol
4674 referred to in h. */
4675 if (h != NULL)
4676 {
cec5225b
YZ		 4677 struct elf_aarch64_link_hash_entry *eh;
4678 eh = (struct elf_aarch64_link_hash_entry *) h;
a06ea964
NC		 4679 return &eh->tlsdesc_got_jump_table_offset;
4680 }
4681 else
4682 {
4683 /* local symbol */
4684 struct elf_aarch64_local_symbol *l;
4685
cec5225b 4686 l = elf_aarch64_locals (input_bfd);
a06ea964
NC		 4687 return &l[r_symndx].tlsdesc_got_jump_table_offset;
4688 }
4689}
4690
4691static void
4692symbol_tlsdesc_got_offset_mark (bfd *input_bfd, struct elf_link_hash_entry *h,
4693 unsigned long r_symndx)
4694{
4695 bfd_vma *p;
4696 p = symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
4697 *p |= 1;
4698}
4699
4700static int
4701symbol_tlsdesc_got_offset_mark_p (bfd *input_bfd,
4702 struct elf_link_hash_entry *h,
4703 unsigned long r_symndx)
4704{
4705 bfd_vma value;
4706 value = * symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
4707 return value & 1;
4708}
4709
4710static bfd_vma
4711symbol_tlsdesc_got_offset (bfd *input_bfd, struct elf_link_hash_entry *h,
4712 unsigned long r_symndx)
4713{
4714 bfd_vma value;
4715 value = * symbol_tlsdesc_got_offset_ref (input_bfd, h, r_symndx);
4716 value &= ~1;
4717 return value;
4718}
4719
68fcca92
JW		 4720/* Data for make_branch_to_erratum_835769_stub(). */
4721
4722struct erratum_835769_branch_to_stub_data
4723{
4106101c 4724 struct bfd_link_info *info;
68fcca92
JW		 4725 asection *output_section;
4726 bfd_byte *contents;
4727};
4728
4729/* Helper to insert branches to erratum 835769 stubs in the right
4730 places for a particular section. */
4731
4732static bfd_boolean
4733make_branch_to_erratum_835769_stub (struct bfd_hash_entry *gen_entry,
4734 void *in_arg)
4735{
4736 struct elf_aarch64_stub_hash_entry *stub_entry;
4737 struct erratum_835769_branch_to_stub_data *data;
4738 bfd_byte *contents;
4739 unsigned long branch_insn = 0;
4740 bfd_vma veneered_insn_loc, veneer_entry_loc;
4741 bfd_signed_vma branch_offset;
4742 unsigned int target;
4743 bfd *abfd;
4744
4745 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
4746 data = (struct erratum_835769_branch_to_stub_data *) in_arg;
4747
4748 if (stub_entry->target_section != data->output_section
4749 || stub_entry->stub_type != aarch64_stub_erratum_835769_veneer)
4750 return TRUE;
4751
4752 contents = data->contents;
4753 veneered_insn_loc = stub_entry->target_section->output_section->vma
4754 + stub_entry->target_section->output_offset
4755 + stub_entry->target_value;
4756 veneer_entry_loc = stub_entry->stub_sec->output_section->vma
4757 + stub_entry->stub_sec->output_offset
4758 + stub_entry->stub_offset;
4759 branch_offset = veneer_entry_loc - veneered_insn_loc;
4760
4761 abfd = stub_entry->target_section->owner;
4762 if (!aarch64_valid_branch_p (veneer_entry_loc, veneered_insn_loc))
4eca0228
AM		 4763 _bfd_error_handler
4764 (_("%B: error: Erratum 835769 stub out "
4765 "of range (input file too large)"), abfd);
68fcca92
JW		 4766
4767 target = stub_entry->target_value;
4768 branch_insn = 0x14000000;
4769 branch_offset >>= 2;
4770 branch_offset &= 0x3ffffff;
4771 branch_insn |= branch_offset;
4772 bfd_putl32 (branch_insn, &contents[target]);
4773
4774 return TRUE;
4775}
4776
4106101c
MS		 4777
4778static bfd_boolean
4779_bfd_aarch64_erratum_843419_branch_to_stub (struct bfd_hash_entry *gen_entry,
4780 void *in_arg)
4781{
4782 struct elf_aarch64_stub_hash_entry *stub_entry
4783 = (struct elf_aarch64_stub_hash_entry *) gen_entry;
4784 struct erratum_835769_branch_to_stub_data *data
4785 = (struct erratum_835769_branch_to_stub_data *) in_arg;
4786 struct bfd_link_info *info;
4787 struct elf_aarch64_link_hash_table *htab;
4788 bfd_byte *contents;
4789 asection *section;
4790 bfd *abfd;
4791 bfd_vma place;
4792 uint32_t insn;
4793
4794 info = data->info;
4795 contents = data->contents;
4796 section = data->output_section;
4797
4798 htab = elf_aarch64_hash_table (info);
4799
4800 if (stub_entry->target_section != section
4801 || stub_entry->stub_type != aarch64_stub_erratum_843419_veneer)
4802 return TRUE;
4803
4804 insn = bfd_getl32 (contents + stub_entry->target_value);
4805 bfd_putl32 (insn,
4806 stub_entry->stub_sec->contents + stub_entry->stub_offset);
4807
4808 place = (section->output_section->vma + section->output_offset
4809 + stub_entry->adrp_offset);
4810 insn = bfd_getl32 (contents + stub_entry->adrp_offset);
4811
4812 if ((insn & AARCH64_ADRP_OP_MASK) != AARCH64_ADRP_OP)
4813 abort ();
4814
4815 bfd_signed_vma imm =
4816 (_bfd_aarch64_sign_extend
4817 ((bfd_vma) _bfd_aarch64_decode_adrp_imm (insn) << 12, 33)
4818 - (place & 0xfff));
4819
4820 if (htab->fix_erratum_843419_adr
4821 && (imm >= AARCH64_MIN_ADRP_IMM && imm <= AARCH64_MAX_ADRP_IMM))
4822 {
4823 insn = (_bfd_aarch64_reencode_adr_imm (AARCH64_ADR_OP, imm)
4824 | AARCH64_RT (insn));
4825 bfd_putl32 (insn, contents + stub_entry->adrp_offset);
4826 }
4827 else
4828 {
4829 bfd_vma veneered_insn_loc;
4830 bfd_vma veneer_entry_loc;
4831 bfd_signed_vma branch_offset;
4832 uint32_t branch_insn;
4833
4834 veneered_insn_loc = stub_entry->target_section->output_section->vma
4835 + stub_entry->target_section->output_offset
4836 + stub_entry->target_value;
4837 veneer_entry_loc = stub_entry->stub_sec->output_section->vma
4838 + stub_entry->stub_sec->output_offset
4839 + stub_entry->stub_offset;
4840 branch_offset = veneer_entry_loc - veneered_insn_loc;
4841
4842 abfd = stub_entry->target_section->owner;
4843 if (!aarch64_valid_branch_p (veneer_entry_loc, veneered_insn_loc))
4eca0228 4844 _bfd_error_handler
4106101c
MS		 4845 (_("%B: error: Erratum 843419 stub out "
4846 "of range (input file too large)"), abfd);
4847
4848 branch_insn = 0x14000000;
4849 branch_offset >>= 2;
4850 branch_offset &= 0x3ffffff;
4851 branch_insn |= branch_offset;
4852 bfd_putl32 (branch_insn, contents + stub_entry->target_value);
4853 }
4854 return TRUE;
4855}
4856
4857
68fcca92
JW		 4858static bfd_boolean
4859elfNN_aarch64_write_section (bfd *output_bfd ATTRIBUTE_UNUSED,
4860 struct bfd_link_info *link_info,
4861 asection *sec,
4862 bfd_byte *contents)
4863
4864{
4865 struct elf_aarch64_link_hash_table *globals =
f872121a 4866 elf_aarch64_hash_table (link_info);
68fcca92
JW		 4867
4868 if (globals == NULL)
4869 return FALSE;
4870
4871 /* Fix code to point to erratum 835769 stubs. */
4872 if (globals->fix_erratum_835769)
4873 {
4874 struct erratum_835769_branch_to_stub_data data;
4875
4106101c 4876 data.info = link_info;
68fcca92
JW		 4877 data.output_section = sec;
4878 data.contents = contents;
4879 bfd_hash_traverse (&globals->stub_hash_table,
4880 make_branch_to_erratum_835769_stub, &data);
4881 }
4882
4106101c
MS		 4883 if (globals->fix_erratum_843419)
4884 {
4885 struct erratum_835769_branch_to_stub_data data;
4886
4887 data.info = link_info;
4888 data.output_section = sec;
4889 data.contents = contents;
4890 bfd_hash_traverse (&globals->stub_hash_table,
4891 _bfd_aarch64_erratum_843419_branch_to_stub, &data);
4892 }
4893
68fcca92
JW		 4894 return FALSE;
4895}
4896
4e7fbb34
JW		 4897/* Perform a relocation as part of a final link. The input relocation type
4898 should be TLS relaxed. */
4899
a06ea964 4900static bfd_reloc_status_type
cec5225b 4901elfNN_aarch64_final_link_relocate (reloc_howto_type *howto,
a06ea964
NC		 4902 bfd *input_bfd,
4903 bfd *output_bfd,
4904 asection *input_section,
4905 bfd_byte *contents,
4906 Elf_Internal_Rela *rel,
4907 bfd_vma value,
4908 struct bfd_link_info *info,
4909 asection *sym_sec,
4910 struct elf_link_hash_entry *h,
4911 bfd_boolean *unresolved_reloc_p,
4912 bfd_boolean save_addend,
1419bbe5
WN		 4913 bfd_vma *saved_addend,
4914 Elf_Internal_Sym *sym)
a06ea964 4915{
1419bbe5 4916 Elf_Internal_Shdr *symtab_hdr;
a06ea964 4917 unsigned int r_type = howto->type;
a6bb11b2
YZ		 4918 bfd_reloc_code_real_type bfd_r_type
4919 = elfNN_aarch64_bfd_reloc_from_howto (howto);
a06ea964
NC		 4920 unsigned long r_symndx;
4921 bfd_byte *hit_data = contents + rel->r_offset;
b53b1bed 4922 bfd_vma place, off;
a06ea964 4923 bfd_signed_vma signed_addend;
cec5225b 4924 struct elf_aarch64_link_hash_table *globals;
a06ea964 4925 bfd_boolean weak_undef_p;
b53b1bed 4926 asection *base_got;
a06ea964 4927
cec5225b 4928 globals = elf_aarch64_hash_table (info);
a06ea964 4929
1419bbe5
WN		 4930 symtab_hdr = &elf_symtab_hdr (input_bfd);
4931
a06ea964
NC		 4932 BFD_ASSERT (is_aarch64_elf (input_bfd));
4933
cec5225b 4934 r_symndx = ELFNN_R_SYM (rel->r_info);
a06ea964 4935
a06ea964
NC		 4936 place = input_section->output_section->vma
4937 + input_section->output_offset + rel->r_offset;
4938
4939 /* Get addend, accumulating the addend for consecutive relocs
4940 which refer to the same offset. */
4941 signed_addend = saved_addend ? *saved_addend : 0;
4942 signed_addend += rel->r_addend;
4943
4944 weak_undef_p = (h ? h->root.type == bfd_link_hash_undefweak
4945 : bfd_is_und_section (sym_sec));
a6bb11b2 4946
1419bbe5
WN		 4947 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle
4948 it here if it is defined in a non-shared object. */
4949 if (h != NULL
4950 && h->type == STT_GNU_IFUNC
4951 && h->def_regular)
4952 {
4953 asection *plt;
4954 const char *name;
99ad26cb 4955 bfd_vma addend = 0;
1419bbe5
WN		 4956
4957 if ((input_section->flags & SEC_ALLOC) == 0
4958 || h->plt.offset == (bfd_vma) -1)
4959 abort ();
4960
4961 /* STT_GNU_IFUNC symbol must go through PLT. */
4962 plt = globals->root.splt ? globals->root.splt : globals->root.iplt;
4963 value = (plt->output_section->vma + plt->output_offset + h->plt.offset);
4964
4965 switch (bfd_r_type)
4966 {
4967 default:
4968 if (h->root.root.string)
4969 name = h->root.root.string;
4970 else
4971 name = bfd_elf_sym_name (input_bfd, symtab_hdr, sym,
4972 NULL);
4eca0228 4973 _bfd_error_handler
695344c0 4974 /* xgettext:c-format */
1419bbe5
WN		 4975 (_("%B: relocation %s against STT_GNU_IFUNC "
4976 "symbol `%s' isn't handled by %s"), input_bfd,
4977 howto->name, name, __FUNCTION__);
4978 bfd_set_error (bfd_error_bad_value);
4979 return FALSE;
4980
4981 case BFD_RELOC_AARCH64_NN:
4982 if (rel->r_addend != 0)
4983 {
4984 if (h->root.root.string)
4985 name = h->root.root.string;
4986 else
4987 name = bfd_elf_sym_name (input_bfd, symtab_hdr,
4988 sym, NULL);
4eca0228 4989 _bfd_error_handler
695344c0 4990 /* xgettext:c-format */
1419bbe5
WN		 4991 (_("%B: relocation %s against STT_GNU_IFUNC "
4992 "symbol `%s' has non-zero addend: %d"),
4993 input_bfd, howto->name, name, rel->r_addend);
4994 bfd_set_error (bfd_error_bad_value);
4995 return FALSE;
4996 }
4997
4998 /* Generate dynamic relocation only when there is a
4999 non-GOT reference in a shared object. */
0e1862bb 5000 if (bfd_link_pic (info) && h->non_got_ref)
1419bbe5
WN		 5001 {
5002 Elf_Internal_Rela outrel;
5003 asection *sreloc;
5004
5005 /* Need a dynamic relocation to get the real function
5006 address. */
5007 outrel.r_offset = _bfd_elf_section_offset (output_bfd,
5008 info,
5009 input_section,
5010 rel->r_offset);
5011 if (outrel.r_offset == (bfd_vma) -1
5012 || outrel.r_offset == (bfd_vma) -2)
5013 abort ();
5014
5015 outrel.r_offset += (input_section->output_section->vma
5016 + input_section->output_offset);
5017
5018 if (h->dynindx == -1
5019 || h->forced_local
0e1862bb 5020 || bfd_link_executable (info))
1419bbe5
WN		 5021 {
5022 /* This symbol is resolved locally. */
5023 outrel.r_info = ELFNN_R_INFO (0, AARCH64_R (IRELATIVE));
5024 outrel.r_addend = (h->root.u.def.value
5025 + h->root.u.def.section->output_section->vma
5026 + h->root.u.def.section->output_offset);
5027 }
5028 else
5029 {
5030 outrel.r_info = ELFNN_R_INFO (h->dynindx, r_type);
5031 outrel.r_addend = 0;
5032 }
5033
5034 sreloc = globals->root.irelifunc;
5035 elf_append_rela (output_bfd, sreloc, &outrel);
5036
5037 /* If this reloc is against an external symbol, we
5038 do not want to fiddle with the addend. Otherwise,
5039 we need to include the symbol value so that it
5040 becomes an addend for the dynamic reloc. For an
5041 internal symbol, we have updated addend. */
5042 return bfd_reloc_ok;
5043 }
5044 /* FALLTHROUGH */
1419bbe5 5045 case BFD_RELOC_AARCH64_CALL26:
ce336788 5046 case BFD_RELOC_AARCH64_JUMP26:
1419bbe5
WN		 5047 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5048 signed_addend,
5049 weak_undef_p);
5050 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type,
5051 howto, value);
1419bbe5
WN		 5052 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
5053 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 5054 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
ce336788 5055 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
99ad26cb 5056 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
dc8008f5 5057 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G0_NC:
74a1bfe1 5058 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G1:
a2e1db00 5059 case BFD_RELOC_AARCH64_LD64_GOTOFF_LO15:
ce336788 5060 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
1419bbe5
WN		 5061 base_got = globals->root.sgot;
5062 off = h->got.offset;
5063
5064 if (base_got == NULL)
5065 abort ();
5066
5067 if (off == (bfd_vma) -1)
5068 {
5069 bfd_vma plt_index;
5070
5071 /* We can't use h->got.offset here to save state, or
5072 even just remember the offset, as finish_dynamic_symbol
5073 would use that as offset into .got. */
5074
5075 if (globals->root.splt != NULL)
5076 {
b1ee0cc4
WN		 5077 plt_index = ((h->plt.offset - globals->plt_header_size) /
5078 globals->plt_entry_size);
1419bbe5
WN		 5079 off = (plt_index + 3) * GOT_ENTRY_SIZE;
5080 base_got = globals->root.sgotplt;
5081 }
5082 else
5083 {
5084 plt_index = h->plt.offset / globals->plt_entry_size;
5085 off = plt_index * GOT_ENTRY_SIZE;
5086 base_got = globals->root.igotplt;
5087 }
5088
5089 if (h->dynindx == -1
5090 || h->forced_local
5091 || info->symbolic)
5092 {
5093 /* This references the local definition. We must
5094 initialize this entry in the global offset table.
5095 Since the offset must always be a multiple of 8,
5096 we use the least significant bit to record
5097 whether we have initialized it already.
5098
5099 When doing a dynamic link, we create a .rela.got
5100 relocation entry to initialize the value. This
5101 is done in the finish_dynamic_symbol routine. */
5102 if ((off & 1) != 0)
5103 off &= ~1;
5104 else
5105 {
5106 bfd_put_NN (output_bfd, value,
5107 base_got->contents + off);
5108 /* Note that this is harmless as -1 | 1 still is -1. */
5109 h->got.offset |= 1;
5110 }
5111 }
5112 value = (base_got->output_section->vma
5113 + base_got->output_offset + off);
5114 }
5115 else
5116 value = aarch64_calculate_got_entry_vma (h, globals, info,
5117 value, output_bfd,
5118 unresolved_reloc_p);
a0becb89
RL		 5119
5120 switch (bfd_r_type)
5121 {
5122 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
5123 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
5124 addend = (globals->root.sgot->output_section->vma
5125 + globals->root.sgot->output_offset);
5126 break;
dc8008f5 5127 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G0_NC:
74a1bfe1 5128 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G1:
a2e1db00
RL		 5129 case BFD_RELOC_AARCH64_LD64_GOTOFF_LO15:
5130 value = (value - globals->root.sgot->output_section->vma
5131 - globals->root.sgot->output_offset);
a0becb89
RL		 5132 default:
5133 break;
5134 }
5135
1419bbe5 5136 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
99ad26cb 5137 addend, weak_undef_p);
1419bbe5 5138 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type, howto, value);
1419bbe5 5139 case BFD_RELOC_AARCH64_ADD_LO12:
ce336788 5140 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
1419bbe5
WN		 5141 break;
5142 }
5143 }
5144
a6bb11b2 5145 switch (bfd_r_type)
a06ea964 5146 {
a6bb11b2 5147 case BFD_RELOC_AARCH64_NONE:
0484b454 5148 case BFD_RELOC_AARCH64_TLSDESC_ADD:
a6bb11b2 5149 case BFD_RELOC_AARCH64_TLSDESC_CALL:
0484b454 5150 case BFD_RELOC_AARCH64_TLSDESC_LDR:
a06ea964
NC		 5151 *unresolved_reloc_p = FALSE;
5152 return bfd_reloc_ok;
5153
a6bb11b2 5154 case BFD_RELOC_AARCH64_NN:
a06ea964
NC		 5155
5156 /* When generating a shared object or relocatable executable, these
5157 relocations are copied into the output file to be resolved at
5158 run time. */
0e1862bb
L		 5159 if (((bfd_link_pic (info) == TRUE)
5160 || globals->root.is_relocatable_executable)
a06ea964
NC		 5161 && (input_section->flags & SEC_ALLOC)
5162 && (h == NULL
5163 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
5164 || h->root.type != bfd_link_hash_undefweak))
5165 {
5166 Elf_Internal_Rela outrel;
5167 bfd_byte *loc;
5168 bfd_boolean skip, relocate;
5169 asection *sreloc;
5170
5171 *unresolved_reloc_p = FALSE;
5172
a06ea964
NC		 5173 skip = FALSE;
5174 relocate = FALSE;
5175
5176 outrel.r_addend = signed_addend;
5177 outrel.r_offset =
5178 _bfd_elf_section_offset (output_bfd, info, input_section,
5179 rel->r_offset);
5180 if (outrel.r_offset == (bfd_vma) - 1)
5181 skip = TRUE;
5182 else if (outrel.r_offset == (bfd_vma) - 2)
5183 {
5184 skip = TRUE;
5185 relocate = TRUE;
5186 }
5187
5188 outrel.r_offset += (input_section->output_section->vma
5189 + input_section->output_offset);
5190
5191 if (skip)
5192 memset (&outrel, 0, sizeof outrel);
5193 else if (h != NULL
5194 && h->dynindx != -1
0e1862bb
L		 5195 && (!bfd_link_pic (info)
5196 || !SYMBOLIC_BIND (info, h)
5197 || !h->def_regular))
cec5225b 5198 outrel.r_info = ELFNN_R_INFO (h->dynindx, r_type);
a06ea964
NC		 5199 else
5200 {
5201 int symbol;
5202
5203 /* On SVR4-ish systems, the dynamic loader cannot
5204 relocate the text and data segments independently,
5205 so the symbol does not matter. */
5206 symbol = 0;
1f56df9d 5207 relocate = globals->no_apply_dynamic_relocs ? FALSE : TRUE;
a6bb11b2 5208 outrel.r_info = ELFNN_R_INFO (symbol, AARCH64_R (RELATIVE));
a06ea964
NC		 5209 outrel.r_addend += value;
5210 }
5211
1419bbe5
WN		 5212 sreloc = elf_section_data (input_section)->sreloc;
5213 if (sreloc == NULL || sreloc->contents == NULL)
5214 return bfd_reloc_notsupported;
5215
5216 loc = sreloc->contents + sreloc->reloc_count++ * RELOC_SIZE (globals);
cec5225b 5217 bfd_elfNN_swap_reloca_out (output_bfd, &outrel, loc);
a06ea964 5218
1419bbe5 5219 if (sreloc->reloc_count * RELOC_SIZE (globals) > sreloc->size)
a06ea964
NC		 5220 {
5221 /* Sanity to check that we have previously allocated
5222 sufficient space in the relocation section for the
5223 number of relocations we actually want to emit. */
5224 abort ();
5225 }
5226
5227 /* If this reloc is against an external symbol, we do not want to
5228 fiddle with the addend. Otherwise, we need to include the symbol
5229 value so that it becomes an addend for the dynamic reloc. */
5230 if (!relocate)
5231 return bfd_reloc_ok;
5232
5233 return _bfd_final_link_relocate (howto, input_bfd, input_section,
5234 contents, rel->r_offset, value,
5235 signed_addend);
5236 }
5237 else
5238 value += signed_addend;
5239 break;
5240
a6bb11b2 5241 case BFD_RELOC_AARCH64_CALL26:
ce336788 5242 case BFD_RELOC_AARCH64_JUMP26:
a06ea964
NC		 5243 {
5244 asection *splt = globals->root.splt;
5245 bfd_boolean via_plt_p =
5246 splt != NULL && h != NULL && h->plt.offset != (bfd_vma) - 1;
5247
5248 /* A call to an undefined weak symbol is converted to a jump to
5249 the next instruction unless a PLT entry will be created.
5250 The jump to the next instruction is optimized as a NOP.
5251 Do the same for local undefined symbols. */
5252 if (weak_undef_p && ! via_plt_p)
5253 {
5254 bfd_putl32 (INSN_NOP, hit_data);
5255 return bfd_reloc_ok;
5256 }
5257
5258 /* If the call goes through a PLT entry, make sure to
5259 check distance to the right destination address. */
5260 if (via_plt_p)
07f9ddfe
JW		 5261 value = (splt->output_section->vma
5262 + splt->output_offset + h->plt.offset);
5263
5264 /* Check if a stub has to be inserted because the destination
5265 is too far away. */
5266 struct elf_aarch64_stub_hash_entry *stub_entry = NULL;
2f340668
JW		 5267
5268 /* If the branch destination is directed to plt stub, "value" will be
5269 the final destination, otherwise we should plus signed_addend, it may
5270 contain non-zero value, for example call to local function symbol
5271 which are turned into "sec_sym + sec_off", and sec_off is kept in
5272 signed_addend. */
5273 if (! aarch64_valid_branch_p (via_plt_p ? value : value + signed_addend,
5274 place))
07f9ddfe
JW		 5275 /* The target is out of reach, so redirect the branch to
5276 the local stub for this function. */
5277 stub_entry = elfNN_aarch64_get_stub_entry (input_section, sym_sec, h,
5278 rel, globals);
5279 if (stub_entry != NULL)
2f340668
JW		 5280 {
5281 value = (stub_entry->stub_offset
5282 + stub_entry->stub_sec->output_offset
5283 + stub_entry->stub_sec->output_section->vma);
5284
5285 /* We have redirected the destination to stub entry address,
5286 so ignore any addend record in the original rela entry. */
5287 signed_addend = 0;
5288 }
a06ea964 5289 }
caed7120
YZ		 5290 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5291 signed_addend, weak_undef_p);
07f9ddfe 5292 *unresolved_reloc_p = FALSE;
a06ea964
NC		 5293 break;
5294
dcbd20eb
JW		 5295 case BFD_RELOC_AARCH64_16_PCREL:
5296 case BFD_RELOC_AARCH64_32_PCREL:
5297 case BFD_RELOC_AARCH64_64_PCREL:
ce336788
JW		 5298 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
5299 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
5300 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
5301 case BFD_RELOC_AARCH64_LD_LO19_PCREL:
0e1862bb 5302 if (bfd_link_pic (info)
dcbd20eb
JW		 5303 && (input_section->flags & SEC_ALLOC) != 0
5304 && (input_section->flags & SEC_READONLY) != 0
5305 && h != NULL
5306 && !h->def_regular)
5307 {
5308 int howto_index = bfd_r_type - BFD_RELOC_AARCH64_RELOC_START;
5309
4eca0228 5310 _bfd_error_handler
695344c0 5311 /* xgettext:c-format */
dcbd20eb
JW		 5312 (_("%B: relocation %s against external symbol `%s' can not be used"
5313 " when making a shared object; recompile with -fPIC"),
5314 input_bfd, elfNN_aarch64_howto_table[howto_index].name,
5315 h->root.root.string);
5316 bfd_set_error (bfd_error_bad_value);
5317 return FALSE;
5318 }
1a0670f3 5319 /* Fall through. */
dcbd20eb 5320
a6bb11b2 5321 case BFD_RELOC_AARCH64_16:
92d77487
RL		 5322#if ARCH_SIZE == 64
5323 case BFD_RELOC_AARCH64_32:
5324#endif
a6bb11b2 5325 case BFD_RELOC_AARCH64_ADD_LO12:
a6bb11b2 5326 case BFD_RELOC_AARCH64_BRANCH19:
ce336788 5327 case BFD_RELOC_AARCH64_LDST128_LO12:
a6bb11b2
YZ		 5328 case BFD_RELOC_AARCH64_LDST16_LO12:
5329 case BFD_RELOC_AARCH64_LDST32_LO12:
5330 case BFD_RELOC_AARCH64_LDST64_LO12:
ce336788 5331 case BFD_RELOC_AARCH64_LDST8_LO12:
a6bb11b2
YZ		 5332 case BFD_RELOC_AARCH64_MOVW_G0:
5333 case BFD_RELOC_AARCH64_MOVW_G0_NC:
ce336788 5334 case BFD_RELOC_AARCH64_MOVW_G0_S:
a6bb11b2
YZ		 5335 case BFD_RELOC_AARCH64_MOVW_G1:
5336 case BFD_RELOC_AARCH64_MOVW_G1_NC:
ce336788 5337 case BFD_RELOC_AARCH64_MOVW_G1_S:
a6bb11b2
YZ		 5338 case BFD_RELOC_AARCH64_MOVW_G2:
5339 case BFD_RELOC_AARCH64_MOVW_G2_NC:
ce336788 5340 case BFD_RELOC_AARCH64_MOVW_G2_S:
a6bb11b2 5341 case BFD_RELOC_AARCH64_MOVW_G3:
a6bb11b2 5342 case BFD_RELOC_AARCH64_TSTBR14:
caed7120
YZ		 5343 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5344 signed_addend, weak_undef_p);
a06ea964
NC		 5345 break;
5346
a6bb11b2
YZ		 5347 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
5348 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 5349 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
ce336788 5350 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
99ad26cb 5351 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
ce336788 5352 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
a06ea964
NC		 5353 if (globals->root.sgot == NULL)
5354 BFD_ASSERT (h != NULL);
5355
5356 if (h != NULL)
5357 {
99ad26cb 5358 bfd_vma addend = 0;
a06ea964
NC		 5359 value = aarch64_calculate_got_entry_vma (h, globals, info, value,
5360 output_bfd,
5361 unresolved_reloc_p);
7018c030
JW		 5362 if (bfd_r_type == BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15
5363 || bfd_r_type == BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14)
99ad26cb
JW		 5364 addend = (globals->root.sgot->output_section->vma
5365 + globals->root.sgot->output_offset);
caed7120 5366 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
99ad26cb 5367 addend, weak_undef_p);
a06ea964 5368 }
b53b1bed
JW		 5369 else
5370 {
99ad26cb 5371 bfd_vma addend = 0;
b53b1bed
JW		 5372 struct elf_aarch64_local_symbol *locals
5373 = elf_aarch64_locals (input_bfd);
5374
5375 if (locals == NULL)
5376 {
5377 int howto_index = bfd_r_type - BFD_RELOC_AARCH64_RELOC_START;
4eca0228 5378 _bfd_error_handler
695344c0 5379 /* xgettext:c-format */
b53b1bed
JW		 5380 (_("%B: Local symbol descriptor table be NULL when applying "
5381 "relocation %s against local symbol"),
5382 input_bfd, elfNN_aarch64_howto_table[howto_index].name);
5383 abort ();
5384 }
5385
5386 off = symbol_got_offset (input_bfd, h, r_symndx);
5387 base_got = globals->root.sgot;
5388 bfd_vma got_entry_addr = (base_got->output_section->vma
5389 + base_got->output_offset + off);
5390
5391 if (!symbol_got_offset_mark_p (input_bfd, h, r_symndx))
5392 {
5393 bfd_put_64 (output_bfd, value, base_got->contents + off);
5394
0e1862bb 5395 if (bfd_link_pic (info))
b53b1bed
JW		 5396 {
5397 asection *s;
5398 Elf_Internal_Rela outrel;
5399
5400 /* For local symbol, we have done absolute relocation in static
5401 linking stageh. While for share library, we need to update
5402 the content of GOT entry according to the share objects
5403 loading base address. So we need to generate a
5404 R_AARCH64_RELATIVE reloc for dynamic linker. */
5405 s = globals->root.srelgot;
5406 if (s == NULL)
5407 abort ();
5408
5409 outrel.r_offset = got_entry_addr;
5410 outrel.r_info = ELFNN_R_INFO (0, AARCH64_R (RELATIVE));
5411 outrel.r_addend = value;
5412 elf_append_rela (output_bfd, s, &outrel);
5413 }
5414
5415 symbol_got_offset_mark (input_bfd, h, r_symndx);
5416 }
5417
5418 /* Update the relocation value to GOT entry addr as we have transformed
5419 the direct data access into indirect data access through GOT. */
5420 value = got_entry_addr;
99ad26cb 5421
7018c030
JW		 5422 if (bfd_r_type == BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15
5423 || bfd_r_type == BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14)
99ad26cb
JW		 5424 addend = base_got->output_section->vma + base_got->output_offset;
5425
5426 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5427 addend, weak_undef_p);
b53b1bed
JW		 5428 }
5429
a06ea964
NC		 5430 break;
5431
a2e1db00 5432 case BFD_RELOC_AARCH64_LD64_GOTOFF_LO15:
dc8008f5 5433 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G0_NC:
74a1bfe1 5434 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G1:
a2e1db00
RL		 5435 if (h != NULL)
5436 value = aarch64_calculate_got_entry_vma (h, globals, info, value,
5437 output_bfd,
5438 unresolved_reloc_p);
5439 else
5440 {
5441 struct elf_aarch64_local_symbol *locals
5442 = elf_aarch64_locals (input_bfd);
5443
5444 if (locals == NULL)
5445 {
5446 int howto_index = bfd_r_type - BFD_RELOC_AARCH64_RELOC_START;
4eca0228 5447 _bfd_error_handler
695344c0 5448 /* xgettext:c-format */
a2e1db00
RL		 5449 (_("%B: Local symbol descriptor table be NULL when applying "
5450 "relocation %s against local symbol"),
5451 input_bfd, elfNN_aarch64_howto_table[howto_index].name);
5452 abort ();
5453 }
5454
5455 off = symbol_got_offset (input_bfd, h, r_symndx);
5456 base_got = globals->root.sgot;
5457 if (base_got == NULL)
5458 abort ();
5459
5460 bfd_vma got_entry_addr = (base_got->output_section->vma
5461 + base_got->output_offset + off);
5462
5463 if (!symbol_got_offset_mark_p (input_bfd, h, r_symndx))
5464 {
5465 bfd_put_64 (output_bfd, value, base_got->contents + off);
5466
5467 if (bfd_link_pic (info))
5468 {
5469 asection *s;
5470 Elf_Internal_Rela outrel;
5471
5472 /* For local symbol, we have done absolute relocation in static
5473 linking stage. While for share library, we need to update
5474 the content of GOT entry according to the share objects
5475 loading base address. So we need to generate a
5476 R_AARCH64_RELATIVE reloc for dynamic linker. */
5477 s = globals->root.srelgot;
5478 if (s == NULL)
5479 abort ();
5480
5481 outrel.r_offset = got_entry_addr;
5482 outrel.r_info = ELFNN_R_INFO (0, AARCH64_R (RELATIVE));
5483 outrel.r_addend = value;
5484 elf_append_rela (output_bfd, s, &outrel);
5485 }
5486
5487 symbol_got_offset_mark (input_bfd, h, r_symndx);
5488 }
5489 }
5490
5491 /* Update the relocation value to GOT entry addr as we have transformed
5492 the direct data access into indirect data access through GOT. */
5493 value = symbol_got_offset (input_bfd, h, r_symndx);
5494 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5495 0, weak_undef_p);
5496 *unresolved_reloc_p = FALSE;
5497 break;
5498
ce336788 5499 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a6bb11b2 5500 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 5501 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
a6bb11b2 5502 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a6bb11b2 5503 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
ce336788 5504 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
043bf05a 5505 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
73f925cc 5506 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 5507 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 5508 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a06ea964
NC		 5509 if (globals->root.sgot == NULL)
5510 return bfd_reloc_notsupported;
5511
5512 value = (symbol_got_offset (input_bfd, h, r_symndx)
5513 + globals->root.sgot->output_section->vma
f44a1f8e 5514 + globals->root.sgot->output_offset);
a06ea964 5515
caed7120
YZ		 5516 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5517 0, weak_undef_p);
a06ea964
NC		 5518 *unresolved_reloc_p = FALSE;
5519 break;
5520
7ba7cfe4 5521 case BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC:
94facae3 5522 case BFD_RELOC_AARCH64_TLSGD_MOVW_G1:
3b957e5b
RL		 5523 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC:
5524 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1:
94facae3
RL		 5525 if (globals->root.sgot == NULL)
5526 return bfd_reloc_notsupported;
5527
5528 value = symbol_got_offset (input_bfd, h, r_symndx);
5529 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5530 0, weak_undef_p);
5531 *unresolved_reloc_p = FALSE;
5532 break;
5533
6ffe9a1b 5534 case BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_HI12:
40fbed84 5535 case BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12:
753999c1 5536 case BFD_RELOC_AARCH64_TLSLD_ADD_DTPREL_LO12_NC:
07c9aa07
JW		 5537 case BFD_RELOC_AARCH64_TLSLD_LDST16_DTPREL_LO12:
5538 case BFD_RELOC_AARCH64_TLSLD_LDST16_DTPREL_LO12_NC:
5539 case BFD_RELOC_AARCH64_TLSLD_LDST32_DTPREL_LO12:
5540 case BFD_RELOC_AARCH64_TLSLD_LDST32_DTPREL_LO12_NC:
5541 case BFD_RELOC_AARCH64_TLSLD_LDST64_DTPREL_LO12:
5542 case BFD_RELOC_AARCH64_TLSLD_LDST64_DTPREL_LO12_NC:
5543 case BFD_RELOC_AARCH64_TLSLD_LDST8_DTPREL_LO12:
5544 case BFD_RELOC_AARCH64_TLSLD_LDST8_DTPREL_LO12_NC:
6ffe9a1b
JW		 5545 case BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G0:
5546 case BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G0_NC:
5547 case BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G1:
5548 case BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G1_NC:
5549 case BFD_RELOC_AARCH64_TLSLD_MOVW_DTPREL_G2:
40fbed84
JW		 5550 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5551 signed_addend - dtpoff_base (info),
5552 weak_undef_p);
5553 break;
5554
a6bb11b2
YZ		 5555 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_HI12:
5556 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12:
5557 case BFD_RELOC_AARCH64_TLSLE_ADD_TPREL_LO12_NC:
5558 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0:
5559 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G0_NC:
5560 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
5561 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
5562 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
caed7120
YZ		 5563 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5564 signed_addend - tpoff_base (info),
5565 weak_undef_p);
a06ea964
NC		 5566 *unresolved_reloc_p = FALSE;
5567 break;
5568
7bcccb57 5569 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
a6bb11b2 5570 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 5571 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
a6bb11b2 5572 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
7bcccb57 5573 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
1ada945d 5574 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
a06ea964
NC		 5575 if (globals->root.sgot == NULL)
5576 return bfd_reloc_notsupported;
a06ea964
NC		 5577 value = (symbol_tlsdesc_got_offset (input_bfd, h, r_symndx)
5578 + globals->root.sgotplt->output_section->vma
f44a1f8e 5579 + globals->root.sgotplt->output_offset
a06ea964
NC		 5580 + globals->sgotplt_jump_table_size);
5581
caed7120
YZ		 5582 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5583 0, weak_undef_p);
a06ea964
NC		 5584 *unresolved_reloc_p = FALSE;
5585 break;
5586
0484b454
RL		 5587 case BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC:
5588 case BFD_RELOC_AARCH64_TLSDESC_OFF_G1:
5589 if (globals->root.sgot == NULL)
5590 return bfd_reloc_notsupported;
5591
5592 value = (symbol_tlsdesc_got_offset (input_bfd, h, r_symndx)
5593 + globals->root.sgotplt->output_section->vma
5594 + globals->root.sgotplt->output_offset
5595 + globals->sgotplt_jump_table_size);
5596
5597 value -= (globals->root.sgot->output_section->vma
5598 + globals->root.sgot->output_offset);
5599
5600 value = _bfd_aarch64_elf_resolve_relocation (bfd_r_type, place, value,
5601 0, weak_undef_p);
5602 *unresolved_reloc_p = FALSE;
5603 break;
5604
a06ea964
NC		 5605 default:
5606 return bfd_reloc_notsupported;
5607 }
5608
5609 if (saved_addend)
5610 *saved_addend = value;
5611
5612 /* Only apply the final relocation in a sequence. */
5613 if (save_addend)
5614 return bfd_reloc_continue;
5615
caed7120
YZ		 5616 return _bfd_aarch64_elf_put_addend (input_bfd, hit_data, bfd_r_type,
5617 howto, value);
a06ea964
NC		 5618}
5619
5620/* Handle TLS relaxations. Relaxing is possible for symbols that use
5621 R_AARCH64_TLSDESC_ADR_{PAGE, LD64_LO12_NC, ADD_LO12_NC} during a static
5622 link.
5623
5624 Return bfd_reloc_ok if we're done, bfd_reloc_continue if the caller
5625 is to then call final_link_relocate. Return other values in the
5626 case of error. */
5627
5628static bfd_reloc_status_type
cec5225b 5629elfNN_aarch64_tls_relax (struct elf_aarch64_link_hash_table *globals,
a06ea964 5630 bfd *input_bfd, bfd_byte *contents,
06d2788c 5631 Elf_Internal_Rela *rel, struct elf_link_hash_entry *h)
a06ea964
NC		 5632{
5633 bfd_boolean is_local = h == NULL;
cec5225b 5634 unsigned int r_type = ELFNN_R_TYPE (rel->r_info);
a06ea964
NC		 5635 unsigned long insn;
5636
5637 BFD_ASSERT (globals && input_bfd && contents && rel);
5638
a6bb11b2 5639 switch (elfNN_aarch64_bfd_reloc_from_type (r_type))
a06ea964 5640 {
a6bb11b2 5641 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
ce336788 5642 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
a06ea964
NC		 5643 if (is_local)
5644 {
5645 /* GD->LE relaxation:
5646 adrp x0, :tlsgd:var => movz x0, :tprel_g1:var
5647 or
5648 adrp x0, :tlsdesc:var => movz x0, :tprel_g1:var
5649 */
5650 bfd_putl32 (0xd2a00000, contents + rel->r_offset);
5651 return bfd_reloc_continue;
5652 }
5653 else
5654 {
5655 /* GD->IE relaxation:
5656 adrp x0, :tlsgd:var => adrp x0, :gottprel:var
5657 or
5658 adrp x0, :tlsdesc:var => adrp x0, :gottprel:var
5659 */
a06ea964
NC		 5660 return bfd_reloc_continue;
5661 }
5662
389b8029
MS		 5663 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
5664 BFD_ASSERT (0);
5665 break;
5666
1ada945d
MS		 5667 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
5668 if (is_local)
5669 {
5670 /* Tiny TLSDESC->LE relaxation:
5671 ldr x1, :tlsdesc:var => movz x0, #:tprel_g1:var
5672 adr x0, :tlsdesc:var => movk x0, #:tprel_g0_nc:var
5673 .tlsdesccall var
5674 blr x1 => nop
5675 */
5676 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (TLSDESC_ADR_PREL21));
5677 BFD_ASSERT (ELFNN_R_TYPE (rel[2].r_info) == AARCH64_R (TLSDESC_CALL));
5678
5679 rel[1].r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
5680 AARCH64_R (TLSLE_MOVW_TPREL_G0_NC));
5681 rel[2].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5682
5683 bfd_putl32 (0xd2a00000, contents + rel->r_offset);
5684 bfd_putl32 (0xf2800000, contents + rel->r_offset + 4);
5685 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 8);
5686 return bfd_reloc_continue;
5687 }
5688 else
5689 {
5690 /* Tiny TLSDESC->IE relaxation:
5691 ldr x1, :tlsdesc:var => ldr x0, :gottprel:var
5692 adr x0, :tlsdesc:var => nop
5693 .tlsdesccall var
5694 blr x1 => nop
5695 */
5696 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (TLSDESC_ADR_PREL21));
5697 BFD_ASSERT (ELFNN_R_TYPE (rel[2].r_info) == AARCH64_R (TLSDESC_CALL));
5698
5699 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5700 rel[2].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5701
5702 bfd_putl32 (0x58000000, contents + rel->r_offset);
5703 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 4);
5704 bfd_putl32 (INSN_NOP, contents + rel->r_offset + 8);
5705 return bfd_reloc_continue;
5706 }
5707
3c12b054
MS		 5708 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
5709 if (is_local)
5710 {
5711 /* Tiny GD->LE relaxation:
5712 adr x0, :tlsgd:var => mrs x1, tpidr_el0
5713 bl __tls_get_addr => add x0, x1, #:tprel_hi12:x, lsl #12
5714 nop => add x0, x0, #:tprel_lo12_nc:x
5715 */
5716
5717 /* First kill the tls_get_addr reloc on the bl instruction. */
5718 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
5719
5720 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 0);
5721 bfd_putl32 (0x91400020, contents + rel->r_offset + 4);
5722 bfd_putl32 (0x91000000, contents + rel->r_offset + 8);
5723
5724 rel[1].r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
5725 AARCH64_R (TLSLE_ADD_TPREL_LO12_NC));
5726 rel[1].r_offset = rel->r_offset + 8;
5727
5728 /* Move the current relocation to the second instruction in
5729 the sequence. */
5730 rel->r_offset += 4;
5731 rel->r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
5732 AARCH64_R (TLSLE_ADD_TPREL_HI12));
5733 return bfd_reloc_continue;
5734 }
5735 else
5736 {
5737 /* Tiny GD->IE relaxation:
5738 adr x0, :tlsgd:var => ldr x0, :gottprel:var
5739 bl __tls_get_addr => mrs x1, tpidr_el0
5740 nop => add x0, x0, x1
5741 */
5742
5743 /* First kill the tls_get_addr reloc on the bl instruction. */
5744 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
5745 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5746
5747 bfd_putl32 (0x58000000, contents + rel->r_offset);
5748 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 4);
5749 bfd_putl32 (0x8b000020, contents + rel->r_offset + 8);
5750 return bfd_reloc_continue;
5751 }
5752
ac734732
RL		 5753#if ARCH_SIZE == 64
5754 case BFD_RELOC_AARCH64_TLSGD_MOVW_G1:
5755 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (TLSGD_MOVW_G0_NC));
5756 BFD_ASSERT (rel->r_offset + 12 == rel[2].r_offset);
5757 BFD_ASSERT (ELFNN_R_TYPE (rel[2].r_info) == AARCH64_R (CALL26));
5758
5759 if (is_local)
5760 {
5761 /* Large GD->LE relaxation:
5762 movz x0, #:tlsgd_g1:var => movz x0, #:tprel_g2:var, lsl #32
5763 movk x0, #:tlsgd_g0_nc:var => movk x0, #:tprel_g1_nc:var, lsl #16
5764 add x0, gp, x0 => movk x0, #:tprel_g0_nc:var
5765 bl __tls_get_addr => mrs x1, tpidr_el0
5766 nop => add x0, x0, x1
5767 */
5768 rel[2].r_info = ELFNN_R_INFO (ELFNN_R_SYM (rel->r_info),
5769 AARCH64_R (TLSLE_MOVW_TPREL_G0_NC));
5770 rel[2].r_offset = rel->r_offset + 8;
5771
5772 bfd_putl32 (0xd2c00000, contents + rel->r_offset + 0);
5773 bfd_putl32 (0xf2a00000, contents + rel->r_offset + 4);
5774 bfd_putl32 (0xf2800000, contents + rel->r_offset + 8);
5775 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 12);
5776 bfd_putl32 (0x8b000020, contents + rel->r_offset + 16);
5777 }
5778 else
5779 {
5780 /* Large GD->IE relaxation:
5781 movz x0, #:tlsgd_g1:var => movz x0, #:gottprel_g1:var, lsl #16
5782 movk x0, #:tlsgd_g0_nc:var => movk x0, #:gottprel_g0_nc:var
5783 add x0, gp, x0 => ldr x0, [gp, x0]
5784 bl __tls_get_addr => mrs x1, tpidr_el0
5785 nop => add x0, x0, x1
5786 */
5787 rel[2].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5788 bfd_putl32 (0xd2a80000, contents + rel->r_offset + 0);
5789 bfd_putl32 (0x58000000, contents + rel->r_offset + 8);
5790 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 12);
5791 bfd_putl32 (0x8b000020, contents + rel->r_offset + 16);
5792 }
5793 return bfd_reloc_continue;
5794
5795 case BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC:
5796 return bfd_reloc_continue;
5797#endif
5798
043bf05a
MS		 5799 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
5800 return bfd_reloc_continue;
5801
a6bb11b2 5802 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
a06ea964
NC		 5803 if (is_local)
5804 {
5805 /* GD->LE relaxation:
5806 ldr xd, [x0, #:tlsdesc_lo12:var] => movk x0, :tprel_g0_nc:var
5807 */
5808 bfd_putl32 (0xf2800000, contents + rel->r_offset);
5809 return bfd_reloc_continue;
5810 }
5811 else
5812 {
5813 /* GD->IE relaxation:
5814 ldr xd, [x0, #:tlsdesc_lo12:var] => ldr x0, [x0, #:gottprel_lo12:var]
5815 */
5816 insn = bfd_getl32 (contents + rel->r_offset);
fa85fb9a 5817 insn &= 0xffffffe0;
a06ea964
NC		 5818 bfd_putl32 (insn, contents + rel->r_offset);
5819 return bfd_reloc_continue;
5820 }
5821
a6bb11b2 5822 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a06ea964
NC		 5823 if (is_local)
5824 {
5825 /* GD->LE relaxation
5826 add x0, #:tlsgd_lo12:var => movk x0, :tprel_g0_nc:var
5827 bl __tls_get_addr => mrs x1, tpidr_el0
5828 nop => add x0, x1, x0
5829 */
5830
5831 /* First kill the tls_get_addr reloc on the bl instruction. */
5832 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
cec5225b 5833 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
a06ea964
NC		 5834
5835 bfd_putl32 (0xf2800000, contents + rel->r_offset);
5836 bfd_putl32 (0xd53bd041, contents + rel->r_offset + 4);
5837 bfd_putl32 (0x8b000020, contents + rel->r_offset + 8);
5838 return bfd_reloc_continue;
5839 }
5840 else
5841 {
5842 /* GD->IE relaxation
5843 ADD x0, #:tlsgd_lo12:var => ldr x0, [x0, #:gottprel_lo12:var]
5844 BL __tls_get_addr => mrs x1, tpidr_el0
5845 R_AARCH64_CALL26
5846 NOP => add x0, x1, x0
5847 */
5848
a6bb11b2 5849 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (CALL26));
a06ea964
NC		 5850
5851 /* Remove the relocation on the BL instruction. */
cec5225b 5852 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
a06ea964
NC		 5853
5854 bfd_putl32 (0xf9400000, contents + rel->r_offset);
5855
5856 /* We choose to fixup the BL and NOP instructions using the
5857 offset from the second relocation to allow flexibility in
5858 scheduling instructions between the ADD and BL. */
5859 bfd_putl32 (0xd53bd041, contents + rel[1].r_offset);
5860 bfd_putl32 (0x8b000020, contents + rel[1].r_offset + 4);
5861 return bfd_reloc_continue;
5862 }
5863
0484b454 5864 case BFD_RELOC_AARCH64_TLSDESC_ADD:
a6bb11b2
YZ		 5865 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
5866 case BFD_RELOC_AARCH64_TLSDESC_CALL:
a06ea964
NC		 5867 /* GD->IE/LE relaxation:
5868 add x0, x0, #:tlsdesc_lo12:var => nop
5869 blr xd => nop
5870 */
5871 bfd_putl32 (INSN_NOP, contents + rel->r_offset);
5872 return bfd_reloc_ok;
5873
0484b454
RL		 5874 case BFD_RELOC_AARCH64_TLSDESC_LDR:
5875 if (is_local)
5876 {
5877 /* GD->LE relaxation:
5878 ldr xd, [gp, xn] => movk x0, #:tprel_g0_nc:var
5879 */
5880 bfd_putl32 (0xf2800000, contents + rel->r_offset);
5881 return bfd_reloc_continue;
5882 }
5883 else
5884 {
5885 /* GD->IE relaxation:
5886 ldr xd, [gp, xn] => ldr x0, [gp, xn]
5887 */
5888 insn = bfd_getl32 (contents + rel->r_offset);
5889 insn &= 0xffffffe0;
5890 bfd_putl32 (insn, contents + rel->r_offset);
5891 return bfd_reloc_ok;
5892 }
5893
5894 case BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC:
5895 /* GD->LE relaxation:
5896 movk xd, #:tlsdesc_off_g0_nc:var => movk x0, #:tprel_g1_nc:var, lsl #16
5897 GD->IE relaxation:
5898 movk xd, #:tlsdesc_off_g0_nc:var => movk xd, #:gottprel_g0_nc:var
5899 */
5900 if (is_local)
5901 bfd_putl32 (0xf2a00000, contents + rel->r_offset);
5902 return bfd_reloc_continue;
5903
5904 case BFD_RELOC_AARCH64_TLSDESC_OFF_G1:
5905 if (is_local)
5906 {
5907 /* GD->LE relaxation:
5908 movz xd, #:tlsdesc_off_g1:var => movz x0, #:tprel_g2:var, lsl #32
5909 */
5910 bfd_putl32 (0xd2c00000, contents + rel->r_offset);
5911 return bfd_reloc_continue;
5912 }
5913 else
5914 {
5915 /* GD->IE relaxation:
5916 movz xd, #:tlsdesc_off_g1:var => movz xd, #:gottprel_g1:var, lsl #16
5917 */
5918 insn = bfd_getl32 (contents + rel->r_offset);
5919 bfd_putl32 (0xd2a00000 | (insn & 0x1f), contents + rel->r_offset);
5920 return bfd_reloc_continue;
5921 }
5922
a6bb11b2 5923 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a06ea964
NC		 5924 /* IE->LE relaxation:
5925 adrp xd, :gottprel:var => movz xd, :tprel_g1:var
5926 */
5927 if (is_local)
5928 {
5929 insn = bfd_getl32 (contents + rel->r_offset);
5930 bfd_putl32 (0xd2a00000 | (insn & 0x1f), contents + rel->r_offset);
5931 }
5932 return bfd_reloc_continue;
5933
a6bb11b2 5934 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
a06ea964
NC		 5935 /* IE->LE relaxation:
5936 ldr xd, [xm, #:gottprel_lo12:var] => movk xd, :tprel_g0_nc:var
5937 */
5938 if (is_local)
5939 {
5940 insn = bfd_getl32 (contents + rel->r_offset);
5941 bfd_putl32 (0xf2800000 | (insn & 0x1f), contents + rel->r_offset);
5942 }
5943 return bfd_reloc_continue;
5944
259364ad
JW		 5945 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
5946 /* LD->LE relaxation (tiny):
5947 adr x0, :tlsldm:x => mrs x0, tpidr_el0
5948 bl __tls_get_addr => add x0, x0, TCB_SIZE
5949 */
5950 if (is_local)
5951 {
5952 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
5953 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (CALL26));
5954 /* No need of CALL26 relocation for tls_get_addr. */
5955 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5956 bfd_putl32 (0xd53bd040, contents + rel->r_offset + 0);
5957 bfd_putl32 (0x91004000, contents + rel->r_offset + 4);
5958 return bfd_reloc_ok;
5959 }
5960 return bfd_reloc_continue;
5961
5962 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
5963 /* LD->LE relaxation (small):
5964 adrp x0, :tlsldm:x => mrs x0, tpidr_el0
5965 */
5966 if (is_local)
5967 {
5968 bfd_putl32 (0xd53bd040, contents + rel->r_offset);
5969 return bfd_reloc_ok;
5970 }
5971 return bfd_reloc_continue;
5972
5973 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
5974 /* LD->LE relaxation (small):
5975 add x0, #:tlsldm_lo12:x => add x0, x0, TCB_SIZE
5976 bl __tls_get_addr => nop
5977 */
5978 if (is_local)
5979 {
5980 BFD_ASSERT (rel->r_offset + 4 == rel[1].r_offset);
5981 BFD_ASSERT (ELFNN_R_TYPE (rel[1].r_info) == AARCH64_R (CALL26));
5982 /* No need of CALL26 relocation for tls_get_addr. */
5983 rel[1].r_info = ELFNN_R_INFO (STN_UNDEF, R_AARCH64_NONE);
5984 bfd_putl32 (0x91004000, contents + rel->r_offset + 0);
5985 bfd_putl32 (0xd503201f, contents + rel->r_offset + 4);
5986 return bfd_reloc_ok;
5987 }
5988 return bfd_reloc_continue;
5989
a06ea964
NC		 5990 default:
5991 return bfd_reloc_continue;
5992 }
5993
5994 return bfd_reloc_ok;
5995}
5996
5997/* Relocate an AArch64 ELF section. */
5998
5999static bfd_boolean
cec5225b 6000elfNN_aarch64_relocate_section (bfd *output_bfd,
a06ea964
NC		 6001 struct bfd_link_info *info,
6002 bfd *input_bfd,
6003 asection *input_section,
6004 bfd_byte *contents,
6005 Elf_Internal_Rela *relocs,
6006 Elf_Internal_Sym *local_syms,
6007 asection **local_sections)
6008{
6009 Elf_Internal_Shdr *symtab_hdr;
6010 struct elf_link_hash_entry **sym_hashes;
6011 Elf_Internal_Rela *rel;
6012 Elf_Internal_Rela *relend;
6013 const char *name;
cec5225b 6014 struct elf_aarch64_link_hash_table *globals;
a06ea964
NC		 6015 bfd_boolean save_addend = FALSE;
6016 bfd_vma addend = 0;
6017
cec5225b 6018 globals = elf_aarch64_hash_table (info);
a06ea964
NC		 6019
6020 symtab_hdr = &elf_symtab_hdr (input_bfd);
6021 sym_hashes = elf_sym_hashes (input_bfd);
6022
6023 rel = relocs;
6024 relend = relocs + input_section->reloc_count;
6025 for (; rel < relend; rel++)
6026 {
6027 unsigned int r_type;
a6bb11b2
YZ		 6028 bfd_reloc_code_real_type bfd_r_type;
6029 bfd_reloc_code_real_type relaxed_bfd_r_type;
a06ea964
NC		 6030 reloc_howto_type *howto;
6031 unsigned long r_symndx;
6032 Elf_Internal_Sym *sym;
6033 asection *sec;
6034 struct elf_link_hash_entry *h;
6035 bfd_vma relocation;
6036 bfd_reloc_status_type r;
6037 arelent bfd_reloc;
6038 char sym_type;
6039 bfd_boolean unresolved_reloc = FALSE;
6040 char *error_message = NULL;
6041
cec5225b
YZ		 6042 r_symndx = ELFNN_R_SYM (rel->r_info);
6043 r_type = ELFNN_R_TYPE (rel->r_info);
a06ea964 6044
cec5225b 6045 bfd_reloc.howto = elfNN_aarch64_howto_from_type (r_type);
a06ea964
NC		 6046 howto = bfd_reloc.howto;
6047
7fcfd62d
NC		 6048 if (howto == NULL)
6049 {
695344c0 6050 /* xgettext:c-format */
4eca0228 6051 _bfd_error_handler
7fcfd62d
NC		 6052 (_("%B: unrecognized relocation (0x%x) in section `%A'"),
6053 input_bfd, input_section, r_type);
6054 return FALSE;
6055 }
a6bb11b2 6056 bfd_r_type = elfNN_aarch64_bfd_reloc_from_howto (howto);
7fcfd62d 6057
a06ea964
NC		 6058 h = NULL;
6059 sym = NULL;
6060 sec = NULL;
6061
6062 if (r_symndx < symtab_hdr->sh_info)
6063 {
6064 sym = local_syms + r_symndx;
cec5225b 6065 sym_type = ELFNN_ST_TYPE (sym->st_info);
a06ea964
NC		 6066 sec = local_sections[r_symndx];
6067
6068 /* An object file might have a reference to a local
6069 undefined symbol. This is a daft object file, but we
6070 should at least do something about it. */
6071 if (r_type != R_AARCH64_NONE && r_type != R_AARCH64_NULL
6072 && bfd_is_und_section (sec)
6073 && ELF_ST_BIND (sym->st_info) != STB_WEAK)
1a72702b
AM		 6074 (*info->callbacks->undefined_symbol)
6075 (info, bfd_elf_string_from_elf_section
6076 (input_bfd, symtab_hdr->sh_link, sym->st_name),
6077 input_bfd, input_section, rel->r_offset, TRUE);
a06ea964 6078
a06ea964 6079 relocation = _bfd_elf_rela_local_sym (output_bfd, sym, &sec, rel);
1419bbe5
WN		 6080
6081 /* Relocate against local STT_GNU_IFUNC symbol. */
0e1862bb 6082 if (!bfd_link_relocatable (info)
1419bbe5
WN		 6083 && ELF_ST_TYPE (sym->st_info) == STT_GNU_IFUNC)
6084 {
6085 h = elfNN_aarch64_get_local_sym_hash (globals, input_bfd,
6086 rel, FALSE);
6087 if (h == NULL)
6088 abort ();
6089
6090 /* Set STT_GNU_IFUNC symbol value. */
6091 h->root.u.def.value = sym->st_value;
6092 h->root.u.def.section = sec;
6093 }
a06ea964
NC		 6094 }
6095 else
6096 {
62d887d4 6097 bfd_boolean warned, ignored;
a06ea964
NC		 6098
6099 RELOC_FOR_GLOBAL_SYMBOL (info, input_bfd, input_section, rel,
6100 r_symndx, symtab_hdr, sym_hashes,
6101 h, sec, relocation,
62d887d4 6102 unresolved_reloc, warned, ignored);
a06ea964
NC		 6103
6104 sym_type = h->type;
6105 }
6106
6107 if (sec != NULL && discarded_section (sec))
6108 RELOC_AGAINST_DISCARDED_SECTION (info, input_bfd, input_section,
6109 rel, 1, relend, howto, 0, contents);
6110
0e1862bb 6111 if (bfd_link_relocatable (info))
2e0488d3 6112 continue;
a06ea964
NC		 6113
6114 if (h != NULL)
6115 name = h->root.root.string;
6116 else
6117 {
6118 name = (bfd_elf_string_from_elf_section
6119 (input_bfd, symtab_hdr->sh_link, sym->st_name));
6120 if (name == NULL || *name == '\0')
6121 name = bfd_section_name (input_bfd, sec);
6122 }
6123
6124 if (r_symndx != 0
6125 && r_type != R_AARCH64_NONE
6126 && r_type != R_AARCH64_NULL
6127 && (h == NULL
6128 || h->root.type == bfd_link_hash_defined
6129 || h->root.type == bfd_link_hash_defweak)
a6bb11b2 6130 && IS_AARCH64_TLS_RELOC (bfd_r_type) != (sym_type == STT_TLS))
a06ea964 6131 {
4eca0228 6132 _bfd_error_handler
a06ea964 6133 ((sym_type == STT_TLS
695344c0 6134 /* xgettext:c-format */
a06ea964 6135 ? _("%B(%A+0x%lx): %s used with TLS symbol %s")
695344c0 6136 /* xgettext:c-format */
a06ea964
NC		 6137 : _("%B(%A+0x%lx): %s used with non-TLS symbol %s")),
6138 input_bfd,
6139 input_section, (long) rel->r_offset, howto->name, name);
6140 }
6141
a06ea964
NC		 6142 /* We relax only if we can see that there can be a valid transition
6143 from a reloc type to another.
cec5225b 6144 We call elfNN_aarch64_final_link_relocate unless we're completely
a06ea964
NC		 6145 done, i.e., the relaxation produced the final output we want. */
6146
a6bb11b2
YZ		 6147 relaxed_bfd_r_type = aarch64_tls_transition (input_bfd, info, r_type,
6148 h, r_symndx);
6149 if (relaxed_bfd_r_type != bfd_r_type)
a06ea964 6150 {
a6bb11b2
YZ		 6151 bfd_r_type = relaxed_bfd_r_type;
6152 howto = elfNN_aarch64_howto_from_bfd_reloc (bfd_r_type);
6153 BFD_ASSERT (howto != NULL);
6154 r_type = howto->type;
06d2788c 6155 r = elfNN_aarch64_tls_relax (globals, input_bfd, contents, rel, h);
a06ea964
NC		 6156 unresolved_reloc = 0;
6157 }
6158 else
6159 r = bfd_reloc_continue;
6160
6161 /* There may be multiple consecutive relocations for the
6162 same offset. In that case we are supposed to treat the
6163 output of each relocation as the addend for the next. */
6164 if (rel + 1 < relend
6165 && rel->r_offset == rel[1].r_offset
cec5225b
YZ		 6166 && ELFNN_R_TYPE (rel[1].r_info) != R_AARCH64_NONE
6167 && ELFNN_R_TYPE (rel[1].r_info) != R_AARCH64_NULL)
a06ea964
NC		 6168 save_addend = TRUE;
6169 else
6170 save_addend = FALSE;
6171
6172 if (r == bfd_reloc_continue)
cec5225b 6173 r = elfNN_aarch64_final_link_relocate (howto, input_bfd, output_bfd,
a06ea964
NC		 6174 input_section, contents, rel,
6175 relocation, info, sec,
6176 h, &unresolved_reloc,
1419bbe5 6177 save_addend, &addend, sym);
a06ea964 6178
a6bb11b2 6179 switch (elfNN_aarch64_bfd_reloc_from_type (r_type))
a06ea964 6180 {
ce336788 6181 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
a6bb11b2 6182 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 6183 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
7ba7cfe4 6184 case BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC:
94facae3 6185 case BFD_RELOC_AARCH64_TLSGD_MOVW_G1:
73f925cc 6186 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 6187 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 6188 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a06ea964
NC		 6189 if (! symbol_got_offset_mark_p (input_bfd, h, r_symndx))
6190 {
6191 bfd_boolean need_relocs = FALSE;
6192 bfd_byte *loc;
6193 int indx;
6194 bfd_vma off;
6195
6196 off = symbol_got_offset (input_bfd, h, r_symndx);
6197 indx = h && h->dynindx != -1 ? h->dynindx : 0;
6198
6199 need_relocs =
0e1862bb 6200 (bfd_link_pic (info) || indx != 0) &&
a06ea964
NC		 6201 (h == NULL
6202 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
6203 || h->root.type != bfd_link_hash_undefweak);
6204
6205 BFD_ASSERT (globals->root.srelgot != NULL);
6206
6207 if (need_relocs)
6208 {
6209 Elf_Internal_Rela rela;
a6bb11b2 6210 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLS_DTPMOD));
a06ea964
NC		 6211 rela.r_addend = 0;
6212 rela.r_offset = globals->root.sgot->output_section->vma +
6213 globals->root.sgot->output_offset + off;
6214
6215
6216 loc = globals->root.srelgot->contents;
6217 loc += globals->root.srelgot->reloc_count++
6218 * RELOC_SIZE (htab);
cec5225b 6219 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964 6220
f69e4920
JW		 6221 bfd_reloc_code_real_type real_type =
6222 elfNN_aarch64_bfd_reloc_from_type (r_type);
6223
6224 if (real_type == BFD_RELOC_AARCH64_TLSLD_ADR_PREL21
73f925cc
JW		 6225 || real_type == BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21
6226 || real_type == BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC)
77a69ff8
JW		 6227 {
6228 /* For local dynamic, don't generate DTPREL in any case.
6229 Initialize the DTPREL slot into zero, so we get module
6230 base address when invoke runtime TLS resolver. */
6231 bfd_put_NN (output_bfd, 0,
6232 globals->root.sgot->contents + off
6233 + GOT_ENTRY_SIZE);
6234 }
6235 else if (indx == 0)
a06ea964 6236 {
cec5225b 6237 bfd_put_NN (output_bfd,
a06ea964
NC		 6238 relocation - dtpoff_base (info),
6239 globals->root.sgot->contents + off
6240 + GOT_ENTRY_SIZE);
6241 }
6242 else
6243 {
6244 /* This TLS symbol is global. We emit a
6245 relocation to fixup the tls offset at load
6246 time. */
6247 rela.r_info =
a6bb11b2 6248 ELFNN_R_INFO (indx, AARCH64_R (TLS_DTPREL));
a06ea964
NC		 6249 rela.r_addend = 0;
6250 rela.r_offset =
6251 (globals->root.sgot->output_section->vma
6252 + globals->root.sgot->output_offset + off
6253 + GOT_ENTRY_SIZE);
6254
6255 loc = globals->root.srelgot->contents;
6256 loc += globals->root.srelgot->reloc_count++
6257 * RELOC_SIZE (globals);
cec5225b
YZ		 6258 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
6259 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964
NC		 6260 globals->root.sgot->contents + off
6261 + GOT_ENTRY_SIZE);
6262 }
6263 }
6264 else
6265 {
cec5225b 6266 bfd_put_NN (output_bfd, (bfd_vma) 1,
a06ea964 6267 globals->root.sgot->contents + off);
cec5225b 6268 bfd_put_NN (output_bfd,
a06ea964
NC		 6269 relocation - dtpoff_base (info),
6270 globals->root.sgot->contents + off
6271 + GOT_ENTRY_SIZE);
6272 }
6273
6274 symbol_got_offset_mark (input_bfd, h, r_symndx);
6275 }
6276 break;
6277
a6bb11b2
YZ		 6278 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
6279 case BFD_RELOC_AARCH64_TLSIE_LDNN_GOTTPREL_LO12_NC:
043bf05a 6280 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
3b957e5b
RL		 6281 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC:
6282 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1:
a06ea964
NC		 6283 if (! symbol_got_offset_mark_p (input_bfd, h, r_symndx))
6284 {
6285 bfd_boolean need_relocs = FALSE;
6286 bfd_byte *loc;
6287 int indx;
6288 bfd_vma off;
6289
6290 off = symbol_got_offset (input_bfd, h, r_symndx);
6291
6292 indx = h && h->dynindx != -1 ? h->dynindx : 0;
6293
6294 need_relocs =
0e1862bb 6295 (bfd_link_pic (info) || indx != 0) &&
a06ea964
NC		 6296 (h == NULL
6297 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
6298 || h->root.type != bfd_link_hash_undefweak);
6299
6300 BFD_ASSERT (globals->root.srelgot != NULL);
6301
6302 if (need_relocs)
6303 {
6304 Elf_Internal_Rela rela;
6305
6306 if (indx == 0)
6307 rela.r_addend = relocation - dtpoff_base (info);
6308 else
6309 rela.r_addend = 0;
6310
a6bb11b2 6311 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLS_TPREL));
a06ea964
NC		 6312 rela.r_offset = globals->root.sgot->output_section->vma +
6313 globals->root.sgot->output_offset + off;
6314
6315 loc = globals->root.srelgot->contents;
6316 loc += globals->root.srelgot->reloc_count++
6317 * RELOC_SIZE (htab);
6318
cec5225b 6319 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964 6320
cec5225b 6321 bfd_put_NN (output_bfd, rela.r_addend,
a06ea964
NC		 6322 globals->root.sgot->contents + off);
6323 }
6324 else
cec5225b 6325 bfd_put_NN (output_bfd, relocation - tpoff_base (info),
a06ea964
NC		 6326 globals->root.sgot->contents + off);
6327
6328 symbol_got_offset_mark (input_bfd, h, r_symndx);
6329 }
6330 break;
6331
7bcccb57 6332 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
a6bb11b2 6333 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 6334 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
a6bb11b2 6335 case BFD_RELOC_AARCH64_TLSDESC_LDNN_LO12_NC:
1ada945d 6336 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
0484b454
RL		 6337 case BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC:
6338 case BFD_RELOC_AARCH64_TLSDESC_OFF_G1:
a06ea964
NC		 6339 if (! symbol_tlsdesc_got_offset_mark_p (input_bfd, h, r_symndx))
6340 {
6341 bfd_boolean need_relocs = FALSE;
6342 int indx = h && h->dynindx != -1 ? h->dynindx : 0;
6343 bfd_vma off = symbol_tlsdesc_got_offset (input_bfd, h, r_symndx);
6344
6345 need_relocs = (h == NULL
6346 || ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
6347 || h->root.type != bfd_link_hash_undefweak);
6348
6349 BFD_ASSERT (globals->root.srelgot != NULL);
6350 BFD_ASSERT (globals->root.sgot != NULL);
6351
6352 if (need_relocs)
6353 {
6354 bfd_byte *loc;
6355 Elf_Internal_Rela rela;
a6bb11b2
YZ		 6356 rela.r_info = ELFNN_R_INFO (indx, AARCH64_R (TLSDESC));
6357
a06ea964
NC		 6358 rela.r_addend = 0;
6359 rela.r_offset = (globals->root.sgotplt->output_section->vma
6360 + globals->root.sgotplt->output_offset
6361 + off + globals->sgotplt_jump_table_size);
6362
6363 if (indx == 0)
6364 rela.r_addend = relocation - dtpoff_base (info);
6365
6366 /* Allocate the next available slot in the PLT reloc
6367 section to hold our R_AARCH64_TLSDESC, the next
6368 available slot is determined from reloc_count,
6369 which we step. But note, reloc_count was
6370 artifically moved down while allocating slots for
6371 real PLT relocs such that all of the PLT relocs
6372 will fit above the initial reloc_count and the
6373 extra stuff will fit below. */
6374 loc = globals->root.srelplt->contents;
6375 loc += globals->root.srelplt->reloc_count++
6376 * RELOC_SIZE (globals);
6377
cec5225b 6378 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964 6379
cec5225b 6380 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964
NC		 6381 globals->root.sgotplt->contents + off +
6382 globals->sgotplt_jump_table_size);
cec5225b 6383 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964
NC		 6384 globals->root.sgotplt->contents + off +
6385 globals->sgotplt_jump_table_size +
6386 GOT_ENTRY_SIZE);
6387 }
6388
6389 symbol_tlsdesc_got_offset_mark (input_bfd, h, r_symndx);
6390 }
6391 break;
a6bb11b2
YZ		 6392 default:
6393 break;
a06ea964
NC		 6394 }
6395
a06ea964
NC		 6396 /* Dynamic relocs are not propagated for SEC_DEBUGGING sections
6397 because such sections are not SEC_ALLOC and thus ld.so will
6398 not process them. */
6399 if (unresolved_reloc
6400 && !((input_section->flags & SEC_DEBUGGING) != 0
6401 && h->def_dynamic)
6402 && _bfd_elf_section_offset (output_bfd, info, input_section,
6403 +rel->r_offset) != (bfd_vma) - 1)
6404 {
4eca0228 6405 _bfd_error_handler
695344c0
NC		 6406 /* xgettext:c-format */
6407 (_("%B(%A+0x%lx): unresolvable %s relocation against symbol `%s'"),
a06ea964
NC		 6408 input_bfd, input_section, (long) rel->r_offset, howto->name,
6409 h->root.root.string);
6410 return FALSE;
6411 }
6412
6413 if (r != bfd_reloc_ok && r != bfd_reloc_continue)
6414 {
c674f5cd
JW		 6415 bfd_reloc_code_real_type real_r_type
6416 = elfNN_aarch64_bfd_reloc_from_type (r_type);
6417
a06ea964
NC		 6418 switch (r)
6419 {
6420 case bfd_reloc_overflow:
1a72702b
AM		 6421 (*info->callbacks->reloc_overflow)
6422 (info, (h ? &h->root : NULL), name, howto->name, (bfd_vma) 0,
6423 input_bfd, input_section, rel->r_offset);
c674f5cd
JW		 6424 if (real_r_type == BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15
6425 || real_r_type == BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14)
6426 {
6427 (*info->callbacks->warning)
6428 (info,
6429 _("Too many GOT entries for -fpic, "
6430 "please recompile with -fPIC"),
6431 name, input_bfd, input_section, rel->r_offset);
6432 return FALSE;
6433 }
027e9c75
NC		 6434 /* Overflow can occur when a variable is referenced with a type
6435 that has a larger alignment than the type with which it was
6436 declared. eg:
6437 file1.c: extern int foo; int a (void) { return foo; }
6438 file2.c: char bar, foo, baz;
6439 If the variable is placed into a data section at an offset
6440 that is incompatible with the larger alignment requirement
6441 overflow will occur. (Strictly speaking this is not overflow
6442 but rather an alignment problem, but the bfd_reloc_ error
6443 enum does not have a value to cover that situation).
6444
6445 Try to catch this situation here and provide a more helpful
6446 error message to the user. */
6447 if (addend & ((1 << howto->rightshift) - 1)
6448 /* FIXME: Are we testing all of the appropriate reloc
6449 types here ? */
6450 && (real_r_type == BFD_RELOC_AARCH64_LD_LO19_PCREL
6451 || real_r_type == BFD_RELOC_AARCH64_LDST16_LO12
6452 || real_r_type == BFD_RELOC_AARCH64_LDST32_LO12
6453 || real_r_type == BFD_RELOC_AARCH64_LDST64_LO12
6454 || real_r_type == BFD_RELOC_AARCH64_LDST128_LO12))
6455 {
6456 info->callbacks->warning
6457 (info, _("One possible cause of this error is that the \
6458symbol is being referenced in the indicated code as if it had a larger \
6459alignment than was declared where it was defined."),
6460 name, input_bfd, input_section, rel->r_offset);
6461 }
a06ea964
NC		 6462 break;
6463
6464 case bfd_reloc_undefined:
1a72702b
AM		 6465 (*info->callbacks->undefined_symbol)
6466 (info, name, input_bfd, input_section, rel->r_offset, TRUE);
a06ea964
NC		 6467 break;
6468
6469 case bfd_reloc_outofrange:
6470 error_message = _("out of range");
6471 goto common_error;
6472
6473 case bfd_reloc_notsupported:
6474 error_message = _("unsupported relocation");
6475 goto common_error;
6476
6477 case bfd_reloc_dangerous:
6478 /* error_message should already be set. */
6479 goto common_error;
6480
6481 default:
6482 error_message = _("unknown error");
6483 /* Fall through. */
6484
6485 common_error:
6486 BFD_ASSERT (error_message != NULL);
1a72702b
AM		 6487 (*info->callbacks->reloc_dangerous)
6488 (info, error_message, input_bfd, input_section, rel->r_offset);
a06ea964
NC		 6489 break;
6490 }
6491 }
027e9c75
NC		 6492
6493 if (!save_addend)
6494 addend = 0;
a06ea964
NC		 6495 }
6496
6497 return TRUE;
6498}
6499
6500/* Set the right machine number. */
6501
6502static bfd_boolean
cec5225b 6503elfNN_aarch64_object_p (bfd *abfd)
a06ea964 6504{
cec5225b
YZ		 6505#if ARCH_SIZE == 32
6506 bfd_default_set_arch_mach (abfd, bfd_arch_aarch64, bfd_mach_aarch64_ilp32);
6507#else
a06ea964 6508 bfd_default_set_arch_mach (abfd, bfd_arch_aarch64, bfd_mach_aarch64);
cec5225b 6509#endif
a06ea964
NC		 6510 return TRUE;
6511}
6512
6513/* Function to keep AArch64 specific flags in the ELF header. */
6514
6515static bfd_boolean
cec5225b 6516elfNN_aarch64_set_private_flags (bfd *abfd, flagword flags)
a06ea964
NC		 6517{
6518 if (elf_flags_init (abfd) && elf_elfheader (abfd)->e_flags != flags)
6519 {
6520 }
6521 else
6522 {
6523 elf_elfheader (abfd)->e_flags = flags;
6524 elf_flags_init (abfd) = TRUE;
6525 }
6526
6527 return TRUE;
6528}
6529
a06ea964
NC		 6530/* Merge backend specific data from an object file to the output
6531 object file when linking. */
6532
6533static bfd_boolean
50e03d47 6534elfNN_aarch64_merge_private_bfd_data (bfd *ibfd, struct bfd_link_info *info)
a06ea964 6535{
50e03d47 6536 bfd *obfd = info->output_bfd;
a06ea964
NC		 6537 flagword out_flags;
6538 flagword in_flags;
6539 bfd_boolean flags_compatible = TRUE;
6540 asection *sec;
6541
6542 /* Check if we have the same endianess. */
50e03d47 6543 if (!_bfd_generic_verify_endian_match (ibfd, info))
a06ea964
NC		 6544 return FALSE;
6545
6546 if (!is_aarch64_elf (ibfd) || !is_aarch64_elf (obfd))
6547 return TRUE;
6548
6549 /* The input BFD must have had its flags initialised. */
6550 /* The following seems bogus to me -- The flags are initialized in
6551 the assembler but I don't think an elf_flags_init field is
6552 written into the object. */
6553 /* BFD_ASSERT (elf_flags_init (ibfd)); */
6554
6555 in_flags = elf_elfheader (ibfd)->e_flags;
6556 out_flags = elf_elfheader (obfd)->e_flags;
6557
6558 if (!elf_flags_init (obfd))
6559 {
6560 /* If the input is the default architecture and had the default
6561 flags then do not bother setting the flags for the output
6562 architecture, instead allow future merges to do this. If no
6563 future merges ever set these flags then they will retain their
6564 uninitialised values, which surprise surprise, correspond
6565 to the default values. */
6566 if (bfd_get_arch_info (ibfd)->the_default
6567 && elf_elfheader (ibfd)->e_flags == 0)
6568 return TRUE;
6569
6570 elf_flags_init (obfd) = TRUE;
6571 elf_elfheader (obfd)->e_flags = in_flags;
6572
6573 if (bfd_get_arch (obfd) == bfd_get_arch (ibfd)
6574 && bfd_get_arch_info (obfd)->the_default)
6575 return bfd_set_arch_mach (obfd, bfd_get_arch (ibfd),
6576 bfd_get_mach (ibfd));
6577
6578 return TRUE;
6579 }
6580
6581 /* Identical flags must be compatible. */
6582 if (in_flags == out_flags)
6583 return TRUE;
6584
6585 /* Check to see if the input BFD actually contains any sections. If
6586 not, its flags may not have been initialised either, but it
6587 cannot actually cause any incompatiblity. Do not short-circuit
6588 dynamic objects; their section list may be emptied by
6589 elf_link_add_object_symbols.
6590
6591 Also check to see if there are no code sections in the input.
6592 In this case there is no need to check for code specific flags.
6593 XXX - do we need to worry about floating-point format compatability
6594 in data sections ? */
6595 if (!(ibfd->flags & DYNAMIC))
6596 {
6597 bfd_boolean null_input_bfd = TRUE;
6598 bfd_boolean only_data_sections = TRUE;
6599
6600 for (sec = ibfd->sections; sec != NULL; sec = sec->next)
6601 {
6602 if ((bfd_get_section_flags (ibfd, sec)
6603 & (SEC_LOAD | SEC_CODE | SEC_HAS_CONTENTS))
6604 == (SEC_LOAD | SEC_CODE | SEC_HAS_CONTENTS))
6605 only_data_sections = FALSE;
6606
6607 null_input_bfd = FALSE;
6608 break;
6609 }
6610
6611 if (null_input_bfd || only_data_sections)
6612 return TRUE;
6613 }
6614
6615 return flags_compatible;
6616}
6617
6618/* Display the flags field. */
6619
6620static bfd_boolean
cec5225b 6621elfNN_aarch64_print_private_bfd_data (bfd *abfd, void *ptr)
a06ea964
NC		 6622{
6623 FILE *file = (FILE *) ptr;
6624 unsigned long flags;
6625
6626 BFD_ASSERT (abfd != NULL && ptr != NULL);
6627
6628 /* Print normal ELF private data. */
6629 _bfd_elf_print_private_bfd_data (abfd, ptr);
6630
6631 flags = elf_elfheader (abfd)->e_flags;
6632 /* Ignore init flag - it may not be set, despite the flags field
6633 containing valid data. */
6634
6635 /* xgettext:c-format */
6636 fprintf (file, _("private flags = %lx:"), elf_elfheader (abfd)->e_flags);
6637
6638 if (flags)
6639 fprintf (file, _("<Unrecognised flag bits set>"));
6640
6641 fputc ('\n', file);
6642
6643 return TRUE;
6644}
6645
6646/* Update the got entry reference counts for the section being removed. */
6647
6648static bfd_boolean
cec5225b 6649elfNN_aarch64_gc_sweep_hook (bfd *abfd,
cb8af559
NC		 6650 struct bfd_link_info *info,
6651 asection *sec,
6652 const Elf_Internal_Rela * relocs)
a06ea964 6653{
cec5225b 6654 struct elf_aarch64_link_hash_table *htab;
59c108f7
NC		 6655 Elf_Internal_Shdr *symtab_hdr;
6656 struct elf_link_hash_entry **sym_hashes;
cb8af559 6657 struct elf_aarch64_local_symbol *locals;
59c108f7
NC		 6658 const Elf_Internal_Rela *rel, *relend;
6659
0e1862bb 6660 if (bfd_link_relocatable (info))
59c108f7
NC		 6661 return TRUE;
6662
cec5225b 6663 htab = elf_aarch64_hash_table (info);
59c108f7
NC		 6664
6665 if (htab == NULL)
6666 return FALSE;
6667
6668 elf_section_data (sec)->local_dynrel = NULL;
6669
6670 symtab_hdr = &elf_symtab_hdr (abfd);
6671 sym_hashes = elf_sym_hashes (abfd);
6672
cec5225b 6673 locals = elf_aarch64_locals (abfd);
59c108f7
NC		 6674
6675 relend = relocs + sec->reloc_count;
6676 for (rel = relocs; rel < relend; rel++)
6677 {
6678 unsigned long r_symndx;
6679 unsigned int r_type;
6680 struct elf_link_hash_entry *h = NULL;
6681
cec5225b 6682 r_symndx = ELFNN_R_SYM (rel->r_info);
8847944f 6683
59c108f7
NC		 6684 if (r_symndx >= symtab_hdr->sh_info)
6685 {
8847944f 6686
59c108f7
NC		 6687 h = sym_hashes[r_symndx - symtab_hdr->sh_info];
6688 while (h->root.type == bfd_link_hash_indirect
6689 || h->root.type == bfd_link_hash_warning)
6690 h = (struct elf_link_hash_entry *) h->root.u.i.link;
59c108f7
NC		 6691 }
6692 else
6693 {
6694 Elf_Internal_Sym *isym;
6695
8847944f 6696 /* A local symbol. */
59c108f7
NC		 6697 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
6698 abfd, r_symndx);
1419bbe5
WN		 6699
6700 /* Check relocation against local STT_GNU_IFUNC symbol. */
6701 if (isym != NULL
6702 && ELF_ST_TYPE (isym->st_info) == STT_GNU_IFUNC)
6703 {
6704 h = elfNN_aarch64_get_local_sym_hash (htab, abfd, rel, FALSE);
6705 if (h == NULL)
6706 abort ();
6707 }
6708 }
6709
6710 if (h)
6711 {
6712 struct elf_aarch64_link_hash_entry *eh;
6713 struct elf_dyn_relocs **pp;
6714 struct elf_dyn_relocs *p;
6715
6716 eh = (struct elf_aarch64_link_hash_entry *) h;
6717
6718 for (pp = &eh->dyn_relocs; (p = *pp) != NULL; pp = &p->next)
6719 if (p->sec == sec)
6720 {
6721 /* Everything must go for SEC. */
6722 *pp = p->next;
6723 break;
6724 }
59c108f7
NC		 6725 }
6726
cec5225b 6727 r_type = ELFNN_R_TYPE (rel->r_info);
a6bb11b2 6728 switch (aarch64_tls_transition (abfd,info, r_type, h ,r_symndx))
59c108f7 6729 {
a6bb11b2 6730 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
7bcccb57 6731 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 6732 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
7bcccb57 6733 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
a2e1db00 6734 case BFD_RELOC_AARCH64_LD64_GOTOFF_LO15:
99ad26cb 6735 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
7bcccb57 6736 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
dc8008f5 6737 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G0_NC:
74a1bfe1 6738 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G1:
7bcccb57
MS		 6739 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
6740 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 6741 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
7bcccb57
MS		 6742 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
6743 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
1ada945d 6744 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
0484b454
RL		 6745 case BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC:
6746 case BFD_RELOC_AARCH64_TLSDESC_OFF_G1:
a6bb11b2 6747 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
7bcccb57 6748 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 6749 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
7ba7cfe4 6750 case BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC:
94facae3 6751 case BFD_RELOC_AARCH64_TLSGD_MOVW_G1:
a6bb11b2 6752 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a6bb11b2 6753 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
7bcccb57 6754 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
043bf05a 6755 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
3b957e5b
RL		 6756 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC:
6757 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1:
73f925cc 6758 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 6759 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 6760 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
a6bb11b2 6761 if (h != NULL)
59c108f7
NC		 6762 {
6763 if (h->got.refcount > 0)
6764 h->got.refcount -= 1;
1419bbe5
WN		 6765
6766 if (h->type == STT_GNU_IFUNC)
6767 {
6768 if (h->plt.refcount > 0)
6769 h->plt.refcount -= 1;
6770 }
59c108f7 6771 }
cb8af559 6772 else if (locals != NULL)
59c108f7 6773 {
cb8af559
NC		 6774 if (locals[r_symndx].got_refcount > 0)
6775 locals[r_symndx].got_refcount -= 1;
59c108f7
NC		 6776 }
6777 break;
6778
a6bb11b2
YZ		 6779 case BFD_RELOC_AARCH64_CALL26:
6780 case BFD_RELOC_AARCH64_JUMP26:
6781 /* If this is a local symbol then we resolve it
6782 directly without creating a PLT entry. */
59c108f7
NC		 6783 if (h == NULL)
6784 continue;
6785
6786 if (h->plt.refcount > 0)
6787 h->plt.refcount -= 1;
6788 break;
6789
ce336788
JW		 6790 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
6791 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
6792 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
614b09ce
JW		 6793 case BFD_RELOC_AARCH64_MOVW_G0_NC:
6794 case BFD_RELOC_AARCH64_MOVW_G1_NC:
6795 case BFD_RELOC_AARCH64_MOVW_G2_NC:
6796 case BFD_RELOC_AARCH64_MOVW_G3:
a6bb11b2 6797 case BFD_RELOC_AARCH64_NN:
0e1862bb 6798 if (h != NULL && bfd_link_executable (info))
59c108f7
NC		 6799 {
6800 if (h->plt.refcount > 0)
6801 h->plt.refcount -= 1;
6802 }
6803 break;
cec5225b 6804
59c108f7
NC		 6805 default:
6806 break;
6807 }
6808 }
6809
a06ea964
NC		 6810 return TRUE;
6811}
6812
6813/* Adjust a symbol defined by a dynamic object and referenced by a
6814 regular object. The current definition is in some section of the
6815 dynamic object, but we're not including those sections. We have to
6816 change the definition to something the rest of the link can
6817 understand. */
6818
6819static bfd_boolean
cec5225b 6820elfNN_aarch64_adjust_dynamic_symbol (struct bfd_link_info *info,
a06ea964
NC		 6821 struct elf_link_hash_entry *h)
6822{
cec5225b 6823 struct elf_aarch64_link_hash_table *htab;
a06ea964
NC		 6824 asection *s;
6825
6826 /* If this is a function, put it in the procedure linkage table. We
6827 will fill in the contents of the procedure linkage table later,
6828 when we know the address of the .got section. */
1419bbe5 6829 if (h->type == STT_FUNC || h->type == STT_GNU_IFUNC || h->needs_plt)
a06ea964
NC		 6830 {
6831 if (h->plt.refcount <= 0
1419bbe5
WN		 6832 || (h->type != STT_GNU_IFUNC
6833 && (SYMBOL_CALLS_LOCAL (info, h)
6834 || (ELF_ST_VISIBILITY (h->other) != STV_DEFAULT
6835 && h->root.type == bfd_link_hash_undefweak))))
a06ea964
NC		 6836 {
6837 /* This case can occur if we saw a CALL26 reloc in
6838 an input file, but the symbol wasn't referred to
6839 by a dynamic object or all references were
6840 garbage collected. In which case we can end up
6841 resolving. */
6842 h->plt.offset = (bfd_vma) - 1;
6843 h->needs_plt = 0;
6844 }
6845
6846 return TRUE;
6847 }
6848 else
80de0c6d 6849 /* Otherwise, reset to -1. */
a06ea964
NC		 6850 h->plt.offset = (bfd_vma) - 1;
6851
6852
6853 /* If this is a weak symbol, and there is a real definition, the
6854 processor independent code will have arranged for us to see the
6855 real definition first, and we can just use the same value. */
6856 if (h->u.weakdef != NULL)
6857 {
6858 BFD_ASSERT (h->u.weakdef->root.type == bfd_link_hash_defined
6859 || h->u.weakdef->root.type == bfd_link_hash_defweak);
6860 h->root.u.def.section = h->u.weakdef->root.u.def.section;
6861 h->root.u.def.value = h->u.weakdef->root.u.def.value;
6862 if (ELIMINATE_COPY_RELOCS || info->nocopyreloc)
6863 h->non_got_ref = h->u.weakdef->non_got_ref;
6864 return TRUE;
6865 }
6866
6867 /* If we are creating a shared library, we must presume that the
6868 only references to the symbol are via the global offset table.
6869 For such cases we need not do anything here; the relocations will
6870 be handled correctly by relocate_section. */
0e1862bb 6871 if (bfd_link_pic (info))
a06ea964
NC		 6872 return TRUE;
6873
6874 /* If there are no references to this symbol that do not use the
6875 GOT, we don't need to generate a copy reloc. */
6876 if (!h->non_got_ref)
6877 return TRUE;
6878
6879 /* If -z nocopyreloc was given, we won't generate them either. */
6880 if (info->nocopyreloc)
6881 {
6882 h->non_got_ref = 0;
6883 return TRUE;
6884 }
6885
6886 /* We must allocate the symbol in our .dynbss section, which will
6887 become part of the .bss section of the executable. There will be
6888 an entry for this symbol in the .dynsym section. The dynamic
6889 object will contain position independent code, so all references
6890 from the dynamic object to this symbol will go through the global
6891 offset table. The dynamic linker will use the .dynsym entry to
6892 determine the address it must put in the global offset table, so
6893 both the dynamic object and the regular object will refer to the
6894 same memory location for the variable. */
6895
cec5225b 6896 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 6897
6898 /* We must generate a R_AARCH64_COPY reloc to tell the dynamic linker
6899 to copy the initial value out of the dynamic object and into the
6900 runtime process image. */
6901 if ((h->root.u.def.section->flags & SEC_ALLOC) != 0 && h->size != 0)
6902 {
6903 htab->srelbss->size += RELOC_SIZE (htab);
6904 h->needs_copy = 1;
6905 }
6906
6907 s = htab->sdynbss;
6908
6cabe1ea 6909 return _bfd_elf_adjust_dynamic_copy (info, h, s);
a06ea964
NC		 6910
6911}
6912
6913static bfd_boolean
cec5225b 6914elfNN_aarch64_allocate_local_symbols (bfd *abfd, unsigned number)
a06ea964
NC		 6915{
6916 struct elf_aarch64_local_symbol *locals;
cec5225b 6917 locals = elf_aarch64_locals (abfd);
a06ea964
NC		 6918 if (locals == NULL)
6919 {
6920 locals = (struct elf_aarch64_local_symbol *)
6921 bfd_zalloc (abfd, number * sizeof (struct elf_aarch64_local_symbol));
6922 if (locals == NULL)
6923 return FALSE;
cec5225b 6924 elf_aarch64_locals (abfd) = locals;
a06ea964
NC		 6925 }
6926 return TRUE;
6927}
6928
cc0efaa8
MS		 6929/* Create the .got section to hold the global offset table. */
6930
6931static bfd_boolean
6932aarch64_elf_create_got_section (bfd *abfd, struct bfd_link_info *info)
6933{
6934 const struct elf_backend_data *bed = get_elf_backend_data (abfd);
6935 flagword flags;
6936 asection *s;
6937 struct elf_link_hash_entry *h;
6938 struct elf_link_hash_table *htab = elf_hash_table (info);
6939
6940 /* This function may be called more than once. */
6941 s = bfd_get_linker_section (abfd, ".got");
6942 if (s != NULL)
6943 return TRUE;
6944
6945 flags = bed->dynamic_sec_flags;
6946
6947 s = bfd_make_section_anyway_with_flags (abfd,
6948 (bed->rela_plts_and_copies_p
6949 ? ".rela.got" : ".rel.got"),
6950 (bed->dynamic_sec_flags
6951 | SEC_READONLY));
6952 if (s == NULL
6953 || ! bfd_set_section_alignment (abfd, s, bed->s->log_file_align))
6954 return FALSE;
6955 htab->srelgot = s;
6956
6957 s = bfd_make_section_anyway_with_flags (abfd, ".got", flags);
6958 if (s == NULL
6959 || !bfd_set_section_alignment (abfd, s, bed->s->log_file_align))
6960 return FALSE;
6961 htab->sgot = s;
6962 htab->sgot->size += GOT_ENTRY_SIZE;
6963
6964 if (bed->want_got_sym)
6965 {
6966 /* Define the symbol _GLOBAL_OFFSET_TABLE_ at the start of the .got
6967 (or .got.plt) section. We don't do this in the linker script
6968 because we don't want to define the symbol if we are not creating
6969 a global offset table. */
6970 h = _bfd_elf_define_linkage_sym (abfd, info, s,
6971 "_GLOBAL_OFFSET_TABLE_");
6972 elf_hash_table (info)->hgot = h;
6973 if (h == NULL)
6974 return FALSE;
6975 }
6976
6977 if (bed->want_got_plt)
6978 {
6979 s = bfd_make_section_anyway_with_flags (abfd, ".got.plt", flags);
6980 if (s == NULL
6981 || !bfd_set_section_alignment (abfd, s,
6982 bed->s->log_file_align))
6983 return FALSE;
6984 htab->sgotplt = s;
6985 }
6986
6987 /* The first bit of the global offset table is the header. */
6988 s->size += bed->got_header_size;
6989
6990 return TRUE;
6991}
6992
a06ea964
NC		 6993/* Look through the relocs for a section during the first phase. */
6994
6995static bfd_boolean
cec5225b 6996elfNN_aarch64_check_relocs (bfd *abfd, struct bfd_link_info *info,
a06ea964
NC		 6997 asection *sec, const Elf_Internal_Rela *relocs)
6998{
6999 Elf_Internal_Shdr *symtab_hdr;
7000 struct elf_link_hash_entry **sym_hashes;
7001 const Elf_Internal_Rela *rel;
7002 const Elf_Internal_Rela *rel_end;
7003 asection *sreloc;
7004
cec5225b 7005 struct elf_aarch64_link_hash_table *htab;
a06ea964 7006
0e1862bb 7007 if (bfd_link_relocatable (info))
a06ea964
NC		 7008 return TRUE;
7009
7010 BFD_ASSERT (is_aarch64_elf (abfd));
7011
cec5225b 7012 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 7013 sreloc = NULL;
7014
7015 symtab_hdr = &elf_symtab_hdr (abfd);
7016 sym_hashes = elf_sym_hashes (abfd);
a06ea964
NC		 7017
7018 rel_end = relocs + sec->reloc_count;
7019 for (rel = relocs; rel < rel_end; rel++)
7020 {
7021 struct elf_link_hash_entry *h;
7022 unsigned long r_symndx;
7023 unsigned int r_type;
a6bb11b2 7024 bfd_reloc_code_real_type bfd_r_type;
1419bbe5 7025 Elf_Internal_Sym *isym;
a06ea964 7026
cec5225b
YZ		 7027 r_symndx = ELFNN_R_SYM (rel->r_info);
7028 r_type = ELFNN_R_TYPE (rel->r_info);
a06ea964
NC		 7029
7030 if (r_symndx >= NUM_SHDR_ENTRIES (symtab_hdr))
7031 {
695344c0 7032 /* xgettext:c-format */
4eca0228 7033 _bfd_error_handler (_("%B: bad symbol index: %d"), abfd, r_symndx);
a06ea964
NC		 7034 return FALSE;
7035 }
7036
ed5acf27 7037 if (r_symndx < symtab_hdr->sh_info)
1419bbe5
WN		 7038 {
7039 /* A local symbol. */
7040 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
7041 abfd, r_symndx);
7042 if (isym == NULL)
7043 return FALSE;
7044
7045 /* Check relocation against local STT_GNU_IFUNC symbol. */
7046 if (ELF_ST_TYPE (isym->st_info) == STT_GNU_IFUNC)
7047 {
7048 h = elfNN_aarch64_get_local_sym_hash (htab, abfd, rel,
7049 TRUE);
7050 if (h == NULL)
7051 return FALSE;
7052
7053 /* Fake a STT_GNU_IFUNC symbol. */
7054 h->type = STT_GNU_IFUNC;
7055 h->def_regular = 1;
7056 h->ref_regular = 1;
7057 h->forced_local = 1;
7058 h->root.type = bfd_link_hash_defined;
7059 }
7060 else
7061 h = NULL;
7062 }
a06ea964
NC		 7063 else
7064 {
7065 h = sym_hashes[r_symndx - symtab_hdr->sh_info];
7066 while (h->root.type == bfd_link_hash_indirect
7067 || h->root.type == bfd_link_hash_warning)
7068 h = (struct elf_link_hash_entry *) h->root.u.i.link;
81fbe831
AM		 7069
7070 /* PR15323, ref flags aren't set for references in the same
7071 object. */
7072 h->root.non_ir_ref = 1;
a06ea964
NC		 7073 }
7074
7075 /* Could be done earlier, if h were already available. */
a6bb11b2 7076 bfd_r_type = aarch64_tls_transition (abfd, info, r_type, h, r_symndx);
a06ea964 7077
1419bbe5
WN		 7078 if (h != NULL)
7079 {
18f822a0
JW		 7080 /* If a relocation refers to _GLOBAL_OFFSET_TABLE_, create the .got.
7081 This shows up in particular in an R_AARCH64_PREL64 in large model
7082 when calculating the pc-relative address to .got section which is
7083 used to initialize the gp register. */
7084 if (h->root.root.string
7085 && strcmp (h->root.root.string, "_GLOBAL_OFFSET_TABLE_") == 0)
7086 {
7087 if (htab->root.dynobj == NULL)
7088 htab->root.dynobj = abfd;
7089
7090 if (! aarch64_elf_create_got_section (htab->root.dynobj, info))
7091 return FALSE;
7092
7093 BFD_ASSERT (h == htab->root.hgot);
7094 }
7095
1419bbe5
WN		 7096 /* Create the ifunc sections for static executables. If we
7097 never see an indirect function symbol nor we are building
7098 a static executable, those sections will be empty and
7099 won't appear in output. */
7100 switch (bfd_r_type)
7101 {
7102 default:
7103 break;
7104
ce336788
JW		 7105 case BFD_RELOC_AARCH64_ADD_LO12:
7106 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
7107 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
1419bbe5 7108 case BFD_RELOC_AARCH64_CALL26:
ce336788 7109 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
1419bbe5 7110 case BFD_RELOC_AARCH64_JUMP26:
7018c030 7111 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
1419bbe5 7112 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
a2e1db00 7113 case BFD_RELOC_AARCH64_LD64_GOTOFF_LO15:
99ad26cb 7114 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
1419bbe5 7115 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
dc8008f5 7116 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G0_NC:
74a1bfe1 7117 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G1:
ce336788 7118 case BFD_RELOC_AARCH64_NN:
1419bbe5
WN		 7119 if (htab->root.dynobj == NULL)
7120 htab->root.dynobj = abfd;
7121 if (!_bfd_elf_create_ifunc_sections (htab->root.dynobj, info))
7122 return FALSE;
7123 break;
7124 }
7125
7126 /* It is referenced by a non-shared object. */
7127 h->ref_regular = 1;
7128 h->root.non_ir_ref = 1;
7129 }
7130
a6bb11b2 7131 switch (bfd_r_type)
a06ea964 7132 {
a6bb11b2 7133 case BFD_RELOC_AARCH64_NN:
a06ea964
NC		 7134
7135 /* We don't need to handle relocs into sections not going into
7136 the "real" output. */
7137 if ((sec->flags & SEC_ALLOC) == 0)
7138 break;
7139
7140 if (h != NULL)
7141 {
0e1862bb 7142 if (!bfd_link_pic (info))
a06ea964
NC		 7143 h->non_got_ref = 1;
7144
7145 h->plt.refcount += 1;
7146 h->pointer_equality_needed = 1;
7147 }
7148
7149 /* No need to do anything if we're not creating a shared
7150 object. */
0e1862bb 7151 if (! bfd_link_pic (info))
a06ea964
NC		 7152 break;
7153
7154 {
7155 struct elf_dyn_relocs *p;
7156 struct elf_dyn_relocs **head;
7157
7158 /* We must copy these reloc types into the output file.
7159 Create a reloc section in dynobj and make room for
7160 this reloc. */
7161 if (sreloc == NULL)
7162 {
7163 if (htab->root.dynobj == NULL)
7164 htab->root.dynobj = abfd;
7165
7166 sreloc = _bfd_elf_make_dynamic_reloc_section
0608afa7 7167 (sec, htab->root.dynobj, LOG_FILE_ALIGN, abfd, /*rela? */ TRUE);
a06ea964
NC		 7168
7169 if (sreloc == NULL)
7170 return FALSE;
7171 }
7172
7173 /* If this is a global symbol, we count the number of
7174 relocations we need for this symbol. */
7175 if (h != NULL)
7176 {
cec5225b
YZ		 7177 struct elf_aarch64_link_hash_entry *eh;
7178 eh = (struct elf_aarch64_link_hash_entry *) h;
a06ea964
NC		 7179 head = &eh->dyn_relocs;
7180 }
7181 else
7182 {
7183 /* Track dynamic relocs needed for local syms too.
7184 We really need local syms available to do this
7185 easily. Oh well. */
7186
7187 asection *s;
7188 void **vpp;
a06ea964
NC		 7189
7190 isym = bfd_sym_from_r_symndx (&htab->sym_cache,
7191 abfd, r_symndx);
7192 if (isym == NULL)
7193 return FALSE;
7194
7195 s = bfd_section_from_elf_index (abfd, isym->st_shndx);
7196 if (s == NULL)
7197 s = sec;
7198
7199 /* Beware of type punned pointers vs strict aliasing
7200 rules. */
7201 vpp = &(elf_section_data (s)->local_dynrel);
7202 head = (struct elf_dyn_relocs **) vpp;
7203 }
7204
7205 p = *head;
7206 if (p == NULL || p->sec != sec)
7207 {
7208 bfd_size_type amt = sizeof *p;
7209 p = ((struct elf_dyn_relocs *)
7210 bfd_zalloc (htab->root.dynobj, amt));
7211 if (p == NULL)
7212 return FALSE;
7213 p->next = *head;
7214 *head = p;
7215 p->sec = sec;
7216 }
7217
7218 p->count += 1;
7219
7220 }
7221 break;
7222
7223 /* RR: We probably want to keep a consistency check that
7224 there are no dangling GOT_PAGE relocs. */
a6bb11b2 7225 case BFD_RELOC_AARCH64_ADR_GOT_PAGE:
7bcccb57 7226 case BFD_RELOC_AARCH64_GOT_LD_PREL19:
7018c030 7227 case BFD_RELOC_AARCH64_LD32_GOTPAGE_LO14:
7bcccb57 7228 case BFD_RELOC_AARCH64_LD32_GOT_LO12_NC:
a2e1db00 7229 case BFD_RELOC_AARCH64_LD64_GOTOFF_LO15:
99ad26cb 7230 case BFD_RELOC_AARCH64_LD64_GOTPAGE_LO15:
7bcccb57 7231 case BFD_RELOC_AARCH64_LD64_GOT_LO12_NC:
dc8008f5 7232 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G0_NC:
74a1bfe1 7233 case BFD_RELOC_AARCH64_MOVW_GOTOFF_G1:
7bcccb57
MS		 7234 case BFD_RELOC_AARCH64_TLSDESC_ADD_LO12_NC:
7235 case BFD_RELOC_AARCH64_TLSDESC_ADR_PAGE21:
389b8029 7236 case BFD_RELOC_AARCH64_TLSDESC_ADR_PREL21:
7bcccb57
MS		 7237 case BFD_RELOC_AARCH64_TLSDESC_LD32_LO12_NC:
7238 case BFD_RELOC_AARCH64_TLSDESC_LD64_LO12_NC:
1ada945d 7239 case BFD_RELOC_AARCH64_TLSDESC_LD_PREL19:
0484b454
RL		 7240 case BFD_RELOC_AARCH64_TLSDESC_OFF_G0_NC:
7241 case BFD_RELOC_AARCH64_TLSDESC_OFF_G1:
a6bb11b2 7242 case BFD_RELOC_AARCH64_TLSGD_ADD_LO12_NC:
7bcccb57 7243 case BFD_RELOC_AARCH64_TLSGD_ADR_PAGE21:
3c12b054 7244 case BFD_RELOC_AARCH64_TLSGD_ADR_PREL21:
7ba7cfe4 7245 case BFD_RELOC_AARCH64_TLSGD_MOVW_G0_NC:
94facae3 7246 case BFD_RELOC_AARCH64_TLSGD_MOVW_G1:
a6bb11b2 7247 case BFD_RELOC_AARCH64_TLSIE_ADR_GOTTPREL_PAGE21:
a6bb11b2 7248 case BFD_RELOC_AARCH64_TLSIE_LD32_GOTTPREL_LO12_NC:
7bcccb57 7249 case BFD_RELOC_AARCH64_TLSIE_LD64_GOTTPREL_LO12_NC:
043bf05a 7250 case BFD_RELOC_AARCH64_TLSIE_LD_GOTTPREL_PREL19:
3b957e5b
RL		 7251 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G0_NC:
7252 case BFD_RELOC_AARCH64_TLSIE_MOVW_GOTTPREL_G1:
73f925cc 7253 case BFD_RELOC_AARCH64_TLSLD_ADD_LO12_NC:
f69e4920 7254 case BFD_RELOC_AARCH64_TLSLD_ADR_PAGE21:
77a69ff8 7255 case BFD_RELOC_AARCH64_TLSLD_ADR_PREL21:
b7a944fe
RL		 7256 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1:
7257 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G1_NC:
7258 case BFD_RELOC_AARCH64_TLSLE_MOVW_TPREL_G2:
a06ea964
NC		 7259 {
7260 unsigned got_type;
7261 unsigned old_got_type;
7262
a6bb11b2 7263 got_type = aarch64_reloc_got_type (bfd_r_type);
a06ea964
NC		 7264
7265 if (h)
7266 {
7267 h->got.refcount += 1;
cec5225b 7268 old_got_type = elf_aarch64_hash_entry (h)->got_type;
a06ea964
NC		 7269 }
7270 else
7271 {
7272 struct elf_aarch64_local_symbol *locals;
7273
cec5225b 7274 if (!elfNN_aarch64_allocate_local_symbols
a06ea964
NC		 7275 (abfd, symtab_hdr->sh_info))
7276 return FALSE;
7277
cec5225b 7278 locals = elf_aarch64_locals (abfd);
a06ea964
NC		 7279 BFD_ASSERT (r_symndx < symtab_hdr->sh_info);
7280 locals[r_symndx].got_refcount += 1;
7281 old_got_type = locals[r_symndx].got_type;
7282 }
7283
7284 /* If a variable is accessed with both general dynamic TLS
7285 methods, two slots may be created. */
7286 if (GOT_TLS_GD_ANY_P (old_got_type) && GOT_TLS_GD_ANY_P (got_type))
7287 got_type |= old_got_type;
7288
7289 /* We will already have issued an error message if there
7290 is a TLS/non-TLS mismatch, based on the symbol type.
7291 So just combine any TLS types needed. */
7292 if (old_got_type != GOT_UNKNOWN && old_got_type != GOT_NORMAL
7293 && got_type != GOT_NORMAL)
7294 got_type |= old_got_type;
7295
7296 /* If the symbol is accessed by both IE and GD methods, we
7297 are able to relax. Turn off the GD flag, without
7298 messing up with any other kind of TLS types that may be
7299 involved. */
7300 if ((got_type & GOT_TLS_IE) && GOT_TLS_GD_ANY_P (got_type))
7301 got_type &= ~ (GOT_TLSDESC_GD | GOT_TLS_GD);
7302
7303 if (old_got_type != got_type)
7304 {
7305 if (h != NULL)
cec5225b 7306 elf_aarch64_hash_entry (h)->got_type = got_type;
a06ea964
NC		 7307 else
7308 {
7309 struct elf_aarch64_local_symbol *locals;
cec5225b 7310 locals = elf_aarch64_locals (abfd);
a06ea964
NC		 7311 BFD_ASSERT (r_symndx < symtab_hdr->sh_info);
7312 locals[r_symndx].got_type = got_type;
7313 }
7314 }
7315
cc0efaa8
MS		 7316 if (htab->root.dynobj == NULL)
7317 htab->root.dynobj = abfd;
7318 if (! aarch64_elf_create_got_section (htab->root.dynobj, info))
7319 return FALSE;
a06ea964
NC		 7320 break;
7321 }
7322
614b09ce
JW		 7323 case BFD_RELOC_AARCH64_MOVW_G0_NC:
7324 case BFD_RELOC_AARCH64_MOVW_G1_NC:
7325 case BFD_RELOC_AARCH64_MOVW_G2_NC:
7326 case BFD_RELOC_AARCH64_MOVW_G3:
0e1862bb 7327 if (bfd_link_pic (info))
614b09ce
JW		 7328 {
7329 int howto_index = bfd_r_type - BFD_RELOC_AARCH64_RELOC_START;
4eca0228 7330 _bfd_error_handler
695344c0 7331 /* xgettext:c-format */
614b09ce
JW		 7332 (_("%B: relocation %s against `%s' can not be used when making "
7333 "a shared object; recompile with -fPIC"),
7334 abfd, elfNN_aarch64_howto_table[howto_index].name,
7335 (h) ? h->root.root.string : "a local symbol");
7336 bfd_set_error (bfd_error_bad_value);
7337 return FALSE;
7338 }
1a0670f3 7339 /* Fall through. */
614b09ce 7340
a6bb11b2
YZ		 7341 case BFD_RELOC_AARCH64_ADR_HI21_NC_PCREL:
7342 case BFD_RELOC_AARCH64_ADR_HI21_PCREL:
7343 case BFD_RELOC_AARCH64_ADR_LO21_PCREL:
0e1862bb 7344 if (h != NULL && bfd_link_executable (info))
a06ea964
NC		 7345 {
7346 /* If this reloc is in a read-only section, we might
7347 need a copy reloc. We can't check reliably at this
7348 stage whether the section is read-only, as input
7349 sections have not yet been mapped to output sections.
7350 Tentatively set the flag for now, and correct in
7351 adjust_dynamic_symbol. */
7352 h->non_got_ref = 1;
7353 h->plt.refcount += 1;
7354 h->pointer_equality_needed = 1;
7355 }
7356 /* FIXME:: RR need to handle these in shared libraries
7357 and essentially bomb out as these being non-PIC
7358 relocations in shared libraries. */
7359 break;
7360
a6bb11b2
YZ		 7361 case BFD_RELOC_AARCH64_CALL26:
7362 case BFD_RELOC_AARCH64_JUMP26:
a06ea964
NC		 7363 /* If this is a local symbol then we resolve it
7364 directly without creating a PLT entry. */
7365 if (h == NULL)
7366 continue;
7367
7368 h->needs_plt = 1;
1419bbe5
WN		 7369 if (h->plt.refcount <= 0)
7370 h->plt.refcount = 1;
7371 else
7372 h->plt.refcount += 1;
a06ea964 7373 break;
a6bb11b2
YZ		 7374
7375 default:
7376 break;
a06ea964
NC		 7377 }
7378 }
a6bb11b2 7379
a06ea964
NC		 7380 return TRUE;
7381}
7382
7383/* Treat mapping symbols as special target symbols. */
7384
7385static bfd_boolean
cec5225b 7386elfNN_aarch64_is_target_special_symbol (bfd *abfd ATTRIBUTE_UNUSED,
a06ea964
NC		 7387 asymbol *sym)
7388{
7389 return bfd_is_aarch64_special_symbol_name (sym->name,
7390 BFD_AARCH64_SPECIAL_SYM_TYPE_ANY);
7391}
7392
7393/* This is a copy of elf_find_function () from elf.c except that
7394 AArch64 mapping symbols are ignored when looking for function names. */
7395
7396static bfd_boolean
7397aarch64_elf_find_function (bfd *abfd ATTRIBUTE_UNUSED,
a06ea964 7398 asymbol **symbols,
fb167eb2 7399 asection *section,
a06ea964
NC		 7400 bfd_vma offset,
7401 const char **filename_ptr,
7402 const char **functionname_ptr)
7403{
7404 const char *filename = NULL;
7405 asymbol *func = NULL;
7406 bfd_vma low_func = 0;
7407 asymbol **p;
7408
7409 for (p = symbols; *p != NULL; p++)
7410 {
7411 elf_symbol_type *q;
7412
7413 q = (elf_symbol_type *) * p;
7414
7415 switch (ELF_ST_TYPE (q->internal_elf_sym.st_info))
7416 {
7417 default:
7418 break;
7419 case STT_FILE:
7420 filename = bfd_asymbol_name (&q->symbol);
7421 break;
7422 case STT_FUNC:
7423 case STT_NOTYPE:
7424 /* Skip mapping symbols. */
7425 if ((q->symbol.flags & BSF_LOCAL)
7426 && (bfd_is_aarch64_special_symbol_name
7427 (q->symbol.name, BFD_AARCH64_SPECIAL_SYM_TYPE_ANY)))
7428 continue;
7429 /* Fall through. */
7430 if (bfd_get_section (&q->symbol) == section
7431 && q->symbol.value >= low_func && q->symbol.value <= offset)
7432 {
7433 func = (asymbol *) q;
7434 low_func = q->symbol.value;
7435 }
7436 break;
7437 }
7438 }
7439
7440 if (func == NULL)
7441 return FALSE;
7442
7443 if (filename_ptr)
7444 *filename_ptr = filename;
7445 if (functionname_ptr)
7446 *functionname_ptr = bfd_asymbol_name (func);
7447
7448 return TRUE;
7449}
7450
7451
7452/* Find the nearest line to a particular section and offset, for error
7453 reporting. This code is a duplicate of the code in elf.c, except
7454 that it uses aarch64_elf_find_function. */
7455
7456static bfd_boolean
cec5225b 7457elfNN_aarch64_find_nearest_line (bfd *abfd,
a06ea964 7458 asymbol **symbols,
fb167eb2 7459 asection *section,
a06ea964
NC		 7460 bfd_vma offset,
7461 const char **filename_ptr,
7462 const char **functionname_ptr,
fb167eb2
AM		 7463 unsigned int *line_ptr,
7464 unsigned int *discriminator_ptr)
a06ea964
NC		 7465{
7466 bfd_boolean found = FALSE;
7467
fb167eb2 7468 if (_bfd_dwarf2_find_nearest_line (abfd, symbols, NULL, section, offset,
a06ea964 7469 filename_ptr, functionname_ptr,
fb167eb2
AM		 7470 line_ptr, discriminator_ptr,
7471 dwarf_debug_sections, 0,
a06ea964
NC		 7472 &elf_tdata (abfd)->dwarf2_find_line_info))
7473 {
7474 if (!*functionname_ptr)
fb167eb2 7475 aarch64_elf_find_function (abfd, symbols, section, offset,
a06ea964
NC		 7476 *filename_ptr ? NULL : filename_ptr,
7477 functionname_ptr);
7478
7479 return TRUE;
7480 }
7481
fb167eb2
AM		 7482 /* Skip _bfd_dwarf1_find_nearest_line since no known AArch64
7483 toolchain uses DWARF1. */
7484
a06ea964
NC		 7485 if (!_bfd_stab_section_find_nearest_line (abfd, symbols, section, offset,
7486 &found, filename_ptr,
7487 functionname_ptr, line_ptr,
7488 &elf_tdata (abfd)->line_info))
7489 return FALSE;
7490
7491 if (found && (*functionname_ptr || *line_ptr))
7492 return TRUE;
7493
7494 if (symbols == NULL)
7495 return FALSE;
7496
fb167eb2 7497 if (!aarch64_elf_find_function (abfd, symbols, section, offset,
a06ea964
NC		 7498 filename_ptr, functionname_ptr))
7499 return FALSE;
7500
7501 *line_ptr = 0;
7502 return TRUE;
7503}
7504
7505static bfd_boolean
cec5225b 7506elfNN_aarch64_find_inliner_info (bfd *abfd,
a06ea964
NC		 7507 const char **filename_ptr,
7508 const char **functionname_ptr,
7509 unsigned int *line_ptr)
7510{
7511 bfd_boolean found;
7512 found = _bfd_dwarf2_find_inliner_info
7513 (abfd, filename_ptr,
7514 functionname_ptr, line_ptr, &elf_tdata (abfd)->dwarf2_find_line_info);
7515 return found;
7516}
7517
7518
7519static void
cec5225b 7520elfNN_aarch64_post_process_headers (bfd *abfd,
1419bbe5 7521 struct bfd_link_info *link_info)
a06ea964
NC		 7522{
7523 Elf_Internal_Ehdr *i_ehdrp; /* ELF file header, internal form. */
7524
7525 i_ehdrp = elf_elfheader (abfd);
a06ea964 7526 i_ehdrp->e_ident[EI_ABIVERSION] = AARCH64_ELF_ABI_VERSION;
1419bbe5 7527
78245035 7528 _bfd_elf_post_process_headers (abfd, link_info);
a06ea964
NC		 7529}
7530
7531static enum elf_reloc_type_class
cec5225b 7532elfNN_aarch64_reloc_type_class (const struct bfd_link_info *info ATTRIBUTE_UNUSED,
7e612e98
AM		 7533 const asection *rel_sec ATTRIBUTE_UNUSED,
7534 const Elf_Internal_Rela *rela)
a06ea964 7535{
cec5225b 7536 switch ((int) ELFNN_R_TYPE (rela->r_info))
a06ea964 7537 {
a6bb11b2 7538 case AARCH64_R (RELATIVE):
a06ea964 7539 return reloc_class_relative;
a6bb11b2 7540 case AARCH64_R (JUMP_SLOT):
a06ea964 7541 return reloc_class_plt;
a6bb11b2 7542 case AARCH64_R (COPY):
a06ea964
NC		 7543 return reloc_class_copy;
7544 default:
7545 return reloc_class_normal;
7546 }
7547}
7548
a06ea964
NC		 7549/* Handle an AArch64 specific section when reading an object file. This is
7550 called when bfd_section_from_shdr finds a section with an unknown
7551 type. */
7552
7553static bfd_boolean
cec5225b 7554elfNN_aarch64_section_from_shdr (bfd *abfd,
a06ea964
NC		 7555 Elf_Internal_Shdr *hdr,
7556 const char *name, int shindex)
7557{
7558 /* There ought to be a place to keep ELF backend specific flags, but
7559 at the moment there isn't one. We just keep track of the
7560 sections by their name, instead. Fortunately, the ABI gives
7561 names for all the AArch64 specific sections, so we will probably get
7562 away with this. */
7563 switch (hdr->sh_type)
7564 {
7565 case SHT_AARCH64_ATTRIBUTES:
7566 break;
7567
7568 default:
7569 return FALSE;
7570 }
7571
7572 if (!_bfd_elf_make_section_from_shdr (abfd, hdr, name, shindex))
7573 return FALSE;
7574
7575 return TRUE;
7576}
7577
7578/* A structure used to record a list of sections, independently
7579 of the next and prev fields in the asection structure. */
7580typedef struct section_list
7581{
7582 asection *sec;
7583 struct section_list *next;
7584 struct section_list *prev;
7585}
7586section_list;
7587
7588/* Unfortunately we need to keep a list of sections for which
7589 an _aarch64_elf_section_data structure has been allocated. This
cec5225b 7590 is because it is possible for functions like elfNN_aarch64_write_section
a06ea964
NC		 7591 to be called on a section which has had an elf_data_structure
7592 allocated for it (and so the used_by_bfd field is valid) but
7593 for which the AArch64 extended version of this structure - the
7594 _aarch64_elf_section_data structure - has not been allocated. */
7595static section_list *sections_with_aarch64_elf_section_data = NULL;
7596
7597static void
7598record_section_with_aarch64_elf_section_data (asection *sec)
7599{
7600 struct section_list *entry;
7601
7602 entry = bfd_malloc (sizeof (*entry));
7603 if (entry == NULL)
7604 return;
7605 entry->sec = sec;
7606 entry->next = sections_with_aarch64_elf_section_data;
7607 entry->prev = NULL;
7608 if (entry->next != NULL)
7609 entry->next->prev = entry;
7610 sections_with_aarch64_elf_section_data = entry;
7611}
7612
7613static struct section_list *
7614find_aarch64_elf_section_entry (asection *sec)
7615{
7616 struct section_list *entry;
7617 static struct section_list *last_entry = NULL;
7618
7619 /* This is a short cut for the typical case where the sections are added
7620 to the sections_with_aarch64_elf_section_data list in forward order and
7621 then looked up here in backwards order. This makes a real difference
7622 to the ld-srec/sec64k.exp linker test. */
7623 entry = sections_with_aarch64_elf_section_data;
7624 if (last_entry != NULL)
7625 {
7626 if (last_entry->sec == sec)
7627 entry = last_entry;
7628 else if (last_entry->next != NULL && last_entry->next->sec == sec)
7629 entry = last_entry->next;
7630 }
7631
7632 for (; entry; entry = entry->next)
7633 if (entry->sec == sec)
7634 break;
7635
7636 if (entry)
7637 /* Record the entry prior to this one - it is the entry we are
7638 most likely to want to locate next time. Also this way if we
7639 have been called from
7640 unrecord_section_with_aarch64_elf_section_data () we will not
7641 be caching a pointer that is about to be freed. */
7642 last_entry = entry->prev;
7643
7644 return entry;
7645}
7646
7647static void
7648unrecord_section_with_aarch64_elf_section_data (asection *sec)
7649{
7650 struct section_list *entry;
7651
7652 entry = find_aarch64_elf_section_entry (sec);
7653
7654 if (entry)
7655 {
7656 if (entry->prev != NULL)
7657 entry->prev->next = entry->next;
7658 if (entry->next != NULL)
7659 entry->next->prev = entry->prev;
7660 if (entry == sections_with_aarch64_elf_section_data)
7661 sections_with_aarch64_elf_section_data = entry->next;
7662 free (entry);
7663 }
7664}
7665
7666
7667typedef struct
7668{
7669 void *finfo;
7670 struct bfd_link_info *info;
7671 asection *sec;
7672 int sec_shndx;
7673 int (*func) (void *, const char *, Elf_Internal_Sym *,
7674 asection *, struct elf_link_hash_entry *);
7675} output_arch_syminfo;
7676
7677enum map_symbol_type
7678{
7679 AARCH64_MAP_INSN,
7680 AARCH64_MAP_DATA
7681};
7682
7683
7684/* Output a single mapping symbol. */
7685
7686static bfd_boolean
cec5225b 7687elfNN_aarch64_output_map_sym (output_arch_syminfo *osi,
a06ea964
NC		 7688 enum map_symbol_type type, bfd_vma offset)
7689{
7690 static const char *names[2] = { "$x", "$d" };
7691 Elf_Internal_Sym sym;
7692
7693 sym.st_value = (osi->sec->output_section->vma
7694 + osi->sec->output_offset + offset);
7695 sym.st_size = 0;
7696 sym.st_other = 0;
7697 sym.st_info = ELF_ST_INFO (STB_LOCAL, STT_NOTYPE);
7698 sym.st_shndx = osi->sec_shndx;
7699 return osi->func (osi->finfo, names[type], &sym, osi->sec, NULL) == 1;
7700}
7701
a06ea964
NC		 7702/* Output a single local symbol for a generated stub. */
7703
7704static bfd_boolean
cec5225b 7705elfNN_aarch64_output_stub_sym (output_arch_syminfo *osi, const char *name,
a06ea964
NC		 7706 bfd_vma offset, bfd_vma size)
7707{
7708 Elf_Internal_Sym sym;
7709
7710 sym.st_value = (osi->sec->output_section->vma
7711 + osi->sec->output_offset + offset);
7712 sym.st_size = size;
7713 sym.st_other = 0;
7714 sym.st_info = ELF_ST_INFO (STB_LOCAL, STT_FUNC);
7715 sym.st_shndx = osi->sec_shndx;
7716 return osi->func (osi->finfo, name, &sym, osi->sec, NULL) == 1;
7717}
7718
7719static bfd_boolean
7720aarch64_map_one_stub (struct bfd_hash_entry *gen_entry, void *in_arg)
7721{
cec5225b 7722 struct elf_aarch64_stub_hash_entry *stub_entry;
a06ea964
NC		 7723 asection *stub_sec;
7724 bfd_vma addr;
7725 char *stub_name;
7726 output_arch_syminfo *osi;
7727
7728 /* Massage our args to the form they really have. */
cec5225b 7729 stub_entry = (struct elf_aarch64_stub_hash_entry *) gen_entry;
a06ea964
NC		 7730 osi = (output_arch_syminfo *) in_arg;
7731
7732 stub_sec = stub_entry->stub_sec;
7733
7734 /* Ensure this stub is attached to the current section being
7735 processed. */
7736 if (stub_sec != osi->sec)
7737 return TRUE;
7738
7739 addr = (bfd_vma) stub_entry->stub_offset;
7740
7741 stub_name = stub_entry->output_name;
7742
7743 switch (stub_entry->stub_type)
7744 {
7745 case aarch64_stub_adrp_branch:
cec5225b 7746 if (!elfNN_aarch64_output_stub_sym (osi, stub_name, addr,
a06ea964
NC		 7747 sizeof (aarch64_adrp_branch_stub)))
7748 return FALSE;
cec5225b 7749 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
a06ea964
NC		 7750 return FALSE;
7751 break;
7752 case aarch64_stub_long_branch:
cec5225b 7753 if (!elfNN_aarch64_output_stub_sym
a06ea964
NC		 7754 (osi, stub_name, addr, sizeof (aarch64_long_branch_stub)))
7755 return FALSE;
cec5225b 7756 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
a06ea964 7757 return FALSE;
cec5225b 7758 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_DATA, addr + 16))
a06ea964
NC		 7759 return FALSE;
7760 break;
68fcca92
JW		 7761 case aarch64_stub_erratum_835769_veneer:
7762 if (!elfNN_aarch64_output_stub_sym (osi, stub_name, addr,
7763 sizeof (aarch64_erratum_835769_stub)))
7764 return FALSE;
7765 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
7766 return FALSE;
7767 break;
4106101c
MS		 7768 case aarch64_stub_erratum_843419_veneer:
7769 if (!elfNN_aarch64_output_stub_sym (osi, stub_name, addr,
7770 sizeof (aarch64_erratum_843419_stub)))
7771 return FALSE;
7772 if (!elfNN_aarch64_output_map_sym (osi, AARCH64_MAP_INSN, addr))
7773 return FALSE;
7774 break;
7775
a06ea964 7776 default:
8e2fe09f 7777 abort ();
a06ea964
NC		 7778 }
7779
7780 return TRUE;
7781}
7782
7783/* Output mapping symbols for linker generated sections. */
7784
7785static bfd_boolean
cec5225b 7786elfNN_aarch64_output_arch_local_syms (bfd *output_bfd,
a06ea964
NC		 7787 struct bfd_link_info *info,
7788 void *finfo,
7789 int (*func) (void *, const char *,
7790 Elf_Internal_Sym *,
7791 asection *,
7792 struct elf_link_hash_entry
7793 *))
7794{
7795 output_arch_syminfo osi;
cec5225b 7796 struct elf_aarch64_link_hash_table *htab;
a06ea964 7797
cec5225b 7798 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 7799
7800 osi.finfo = finfo;
7801 osi.info = info;
7802 osi.func = func;
7803
7804 /* Long calls stubs. */
7805 if (htab->stub_bfd && htab->stub_bfd->sections)
7806 {
7807 asection *stub_sec;
7808
7809 for (stub_sec = htab->stub_bfd->sections;
7810 stub_sec != NULL; stub_sec = stub_sec->next)
7811 {
7812 /* Ignore non-stub sections. */
7813 if (!strstr (stub_sec->name, STUB_SUFFIX))
7814 continue;
7815
7816 osi.sec = stub_sec;
7817
7818 osi.sec_shndx = _bfd_elf_section_from_bfd_section
7819 (output_bfd, osi.sec->output_section);
7820
61865519
MS		 7821 /* The first instruction in a stub is always a branch. */
7822 if (!elfNN_aarch64_output_map_sym (&osi, AARCH64_MAP_INSN, 0))
7823 return FALSE;
7824
a06ea964
NC		 7825 bfd_hash_traverse (&htab->stub_hash_table, aarch64_map_one_stub,
7826 &osi);
7827 }
7828 }
7829
7830 /* Finally, output mapping symbols for the PLT. */
7831 if (!htab->root.splt || htab->root.splt->size == 0)
7832 return TRUE;
7833
a06ea964
NC		 7834 osi.sec_shndx = _bfd_elf_section_from_bfd_section
7835 (output_bfd, htab->root.splt->output_section);
7836 osi.sec = htab->root.splt;
7837
73524045 7838 elfNN_aarch64_output_map_sym (&osi, AARCH64_MAP_INSN, 0);
a06ea964
NC		 7839
7840 return TRUE;
7841
7842}
7843
7844/* Allocate target specific section data. */
7845
7846static bfd_boolean
cec5225b 7847elfNN_aarch64_new_section_hook (bfd *abfd, asection *sec)
a06ea964
NC		 7848{
7849 if (!sec->used_by_bfd)
7850 {
7851 _aarch64_elf_section_data *sdata;
7852 bfd_size_type amt = sizeof (*sdata);
7853
7854 sdata = bfd_zalloc (abfd, amt);
7855 if (sdata == NULL)
7856 return FALSE;
7857 sec->used_by_bfd = sdata;
7858 }
7859
7860 record_section_with_aarch64_elf_section_data (sec);
7861
7862 return _bfd_elf_new_section_hook (abfd, sec);
7863}
7864
7865
7866static void
7867unrecord_section_via_map_over_sections (bfd *abfd ATTRIBUTE_UNUSED,
7868 asection *sec,
7869 void *ignore ATTRIBUTE_UNUSED)
7870{
7871 unrecord_section_with_aarch64_elf_section_data (sec);
7872}
7873
7874static bfd_boolean
cec5225b 7875elfNN_aarch64_close_and_cleanup (bfd *abfd)
a06ea964
NC		 7876{
7877 if (abfd->sections)
7878 bfd_map_over_sections (abfd,
7879 unrecord_section_via_map_over_sections, NULL);
7880
7881 return _bfd_elf_close_and_cleanup (abfd);
7882}
7883
7884static bfd_boolean
cec5225b 7885elfNN_aarch64_bfd_free_cached_info (bfd *abfd)
a06ea964
NC		 7886{
7887 if (abfd->sections)
7888 bfd_map_over_sections (abfd,
7889 unrecord_section_via_map_over_sections, NULL);
7890
7891 return _bfd_free_cached_info (abfd);
7892}
7893
a06ea964
NC		 7894/* Create dynamic sections. This is different from the ARM backend in that
7895 the got, plt, gotplt and their relocation sections are all created in the
7896 standard part of the bfd elf backend. */
7897
7898static bfd_boolean
cec5225b 7899elfNN_aarch64_create_dynamic_sections (bfd *dynobj,
a06ea964
NC		 7900 struct bfd_link_info *info)
7901{
cec5225b 7902 struct elf_aarch64_link_hash_table *htab;
cc0efaa8
MS		 7903
7904 /* We need to create .got section. */
7905 if (!aarch64_elf_create_got_section (dynobj, info))
7906 return FALSE;
a06ea964
NC		 7907
7908 if (!_bfd_elf_create_dynamic_sections (dynobj, info))
7909 return FALSE;
7910
cec5225b 7911 htab = elf_aarch64_hash_table (info);
a06ea964 7912 htab->sdynbss = bfd_get_linker_section (dynobj, ".dynbss");
0e1862bb 7913 if (!bfd_link_pic (info))
a06ea964
NC		 7914 htab->srelbss = bfd_get_linker_section (dynobj, ".rela.bss");
7915
0e1862bb 7916 if (!htab->sdynbss || (!bfd_link_pic (info) && !htab->srelbss))
a06ea964
NC		 7917 abort ();
7918
a06ea964
NC		 7919 return TRUE;
7920}
7921
7922
7923/* Allocate space in .plt, .got and associated reloc sections for
7924 dynamic relocs. */
7925
7926static bfd_boolean
cec5225b 7927elfNN_aarch64_allocate_dynrelocs (struct elf_link_hash_entry *h, void *inf)
a06ea964
NC		 7928{
7929 struct bfd_link_info *info;
cec5225b
YZ		 7930 struct elf_aarch64_link_hash_table *htab;
7931 struct elf_aarch64_link_hash_entry *eh;
a06ea964
NC		 7932 struct elf_dyn_relocs *p;
7933
7934 /* An example of a bfd_link_hash_indirect symbol is versioned
7935 symbol. For example: __gxx_personality_v0(bfd_link_hash_indirect)
7936 -> __gxx_personality_v0(bfd_link_hash_defined)
7937
7938 There is no need to process bfd_link_hash_indirect symbols here
7939 because we will also be presented with the concrete instance of
cec5225b 7940 the symbol and elfNN_aarch64_copy_indirect_symbol () will have been
a06ea964
NC		 7941 called to copy all relevant data from the generic to the concrete
7942 symbol instance.
7943 */
7944 if (h->root.type == bfd_link_hash_indirect)
7945 return TRUE;
7946
7947 if (h->root.type == bfd_link_hash_warning)
7948 h = (struct elf_link_hash_entry *) h->root.u.i.link;
7949
7950 info = (struct bfd_link_info *) inf;
cec5225b 7951 htab = elf_aarch64_hash_table (info);
a06ea964 7952
1419bbe5
WN		 7953 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle it
7954 here if it is defined and referenced in a non-shared object. */
7955 if (h->type == STT_GNU_IFUNC
7956 && h->def_regular)
7957 return TRUE;
7958 else if (htab->root.dynamic_sections_created && h->plt.refcount > 0)
a06ea964
NC		 7959 {
7960 /* Make sure this symbol is output as a dynamic symbol.
7961 Undefined weak syms won't yet be marked as dynamic. */
7962 if (h->dynindx == -1 && !h->forced_local)
7963 {
7964 if (!bfd_elf_link_record_dynamic_symbol (info, h))
7965 return FALSE;
7966 }
7967
0e1862bb 7968 if (bfd_link_pic (info) || WILL_CALL_FINISH_DYNAMIC_SYMBOL (1, 0, h))
a06ea964
NC		 7969 {
7970 asection *s = htab->root.splt;
7971
7972 /* If this is the first .plt entry, make room for the special
7973 first entry. */
7974 if (s->size == 0)
7975 s->size += htab->plt_header_size;
7976
7977 h->plt.offset = s->size;
7978
7979 /* If this symbol is not defined in a regular file, and we are
7980 not generating a shared library, then set the symbol to this
7981 location in the .plt. This is required to make function
7982 pointers compare as equal between the normal executable and
7983 the shared library. */
0e1862bb 7984 if (!bfd_link_pic (info) && !h->def_regular)
a06ea964
NC		 7985 {
7986 h->root.u.def.section = s;
7987 h->root.u.def.value = h->plt.offset;
7988 }
7989
7990 /* Make room for this entry. For now we only create the
7991 small model PLT entries. We later need to find a way
7992 of relaxing into these from the large model PLT entries. */
7993 s->size += PLT_SMALL_ENTRY_SIZE;
7994
7995 /* We also need to make an entry in the .got.plt section, which
7996 will be placed in the .got section by the linker script. */
7997 htab->root.sgotplt->size += GOT_ENTRY_SIZE;
7998
7999 /* We also need to make an entry in the .rela.plt section. */
8000 htab->root.srelplt->size += RELOC_SIZE (htab);
8001
8002 /* We need to ensure that all GOT entries that serve the PLT
8003 are consecutive with the special GOT slots [0] [1] and
8004 [2]. Any addtional relocations, such as
8005 R_AARCH64_TLSDESC, must be placed after the PLT related
8006 entries. We abuse the reloc_count such that during
8007 sizing we adjust reloc_count to indicate the number of
8008 PLT related reserved entries. In subsequent phases when
8009 filling in the contents of the reloc entries, PLT related
8010 entries are placed by computing their PLT index (0
8011 .. reloc_count). While other none PLT relocs are placed
8012 at the slot indicated by reloc_count and reloc_count is
8013 updated. */
8014
8015 htab->root.srelplt->reloc_count++;
8016 }
8017 else
8018 {
8019 h->plt.offset = (bfd_vma) - 1;
8020 h->needs_plt = 0;
8021 }
8022 }
8023 else
8024 {
8025 h->plt.offset = (bfd_vma) - 1;
8026 h->needs_plt = 0;
8027 }
8028
cec5225b 8029 eh = (struct elf_aarch64_link_hash_entry *) h;
a06ea964
NC		 8030 eh->tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
8031
8032 if (h->got.refcount > 0)
8033 {
8034 bfd_boolean dyn;
cec5225b 8035 unsigned got_type = elf_aarch64_hash_entry (h)->got_type;
a06ea964
NC		 8036
8037 h->got.offset = (bfd_vma) - 1;
8038
8039 dyn = htab->root.dynamic_sections_created;
8040
8041 /* Make sure this symbol is output as a dynamic symbol.
8042 Undefined weak syms won't yet be marked as dynamic. */
8043 if (dyn && h->dynindx == -1 && !h->forced_local)
8044 {
8045 if (!bfd_elf_link_record_dynamic_symbol (info, h))
8046 return FALSE;
8047 }
8048
8049 if (got_type == GOT_UNKNOWN)
8050 {
8051 }
8052 else if (got_type == GOT_NORMAL)
8053 {
8054 h->got.offset = htab->root.sgot->size;
8055 htab->root.sgot->size += GOT_ENTRY_SIZE;
8056 if ((ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
8057 || h->root.type != bfd_link_hash_undefweak)
0e1862bb 8058 && (bfd_link_pic (info)
a06ea964
NC		 8059 || WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, 0, h)))
8060 {
8061 htab->root.srelgot->size += RELOC_SIZE (htab);
8062 }
8063 }
8064 else
8065 {
8066 int indx;
8067 if (got_type & GOT_TLSDESC_GD)
8068 {
8069 eh->tlsdesc_got_jump_table_offset =
8070 (htab->root.sgotplt->size
8071 - aarch64_compute_jump_table_size (htab));
8072 htab->root.sgotplt->size += GOT_ENTRY_SIZE * 2;
8073 h->got.offset = (bfd_vma) - 2;
8074 }
8075
8076 if (got_type & GOT_TLS_GD)
8077 {
8078 h->got.offset = htab->root.sgot->size;
8079 htab->root.sgot->size += GOT_ENTRY_SIZE * 2;
8080 }
8081
8082 if (got_type & GOT_TLS_IE)
8083 {
8084 h->got.offset = htab->root.sgot->size;
8085 htab->root.sgot->size += GOT_ENTRY_SIZE;
8086 }
8087
8088 indx = h && h->dynindx != -1 ? h->dynindx : 0;
8089 if ((ELF_ST_VISIBILITY (h->other) == STV_DEFAULT
8090 || h->root.type != bfd_link_hash_undefweak)
0e1862bb 8091 && (bfd_link_pic (info)
a06ea964
NC		 8092 || indx != 0
8093 || WILL_CALL_FINISH_DYNAMIC_SYMBOL (dyn, 0, h)))
8094 {
8095 if (got_type & GOT_TLSDESC_GD)
8096 {
8097 htab->root.srelplt->size += RELOC_SIZE (htab);
8098 /* Note reloc_count not incremented here! We have
8099 already adjusted reloc_count for this relocation
8100 type. */
8101
8102 /* TLSDESC PLT is now needed, but not yet determined. */
8103 htab->tlsdesc_plt = (bfd_vma) - 1;
8104 }
8105
8106 if (got_type & GOT_TLS_GD)
8107 htab->root.srelgot->size += RELOC_SIZE (htab) * 2;
8108
8109 if (got_type & GOT_TLS_IE)
8110 htab->root.srelgot->size += RELOC_SIZE (htab);
8111 }
8112 }
8113 }
8114 else
8115 {
8116 h->got.offset = (bfd_vma) - 1;
8117 }
8118
8119 if (eh->dyn_relocs == NULL)
8120 return TRUE;
8121
8122 /* In the shared -Bsymbolic case, discard space allocated for
8123 dynamic pc-relative relocs against symbols which turn out to be
8124 defined in regular objects. For the normal shared case, discard
8125 space for pc-relative relocs that have become local due to symbol
8126 visibility changes. */
8127
0e1862bb 8128 if (bfd_link_pic (info))
a06ea964
NC		 8129 {
8130 /* Relocs that use pc_count are those that appear on a call
8131 insn, or certain REL relocs that can generated via assembly.
8132 We want calls to protected symbols to resolve directly to the
8133 function rather than going via the plt. If people want
8134 function pointer comparisons to work as expected then they
8135 should avoid writing weird assembly. */
8136 if (SYMBOL_CALLS_LOCAL (info, h))
8137 {
8138 struct elf_dyn_relocs **pp;
8139
8140 for (pp = &eh->dyn_relocs; (p = *pp) != NULL;)
8141 {
8142 p->count -= p->pc_count;
8143 p->pc_count = 0;
8144 if (p->count == 0)
8145 *pp = p->next;
8146 else
8147 pp = &p->next;
8148 }
8149 }
8150
8151 /* Also discard relocs on undefined weak syms with non-default
8152 visibility. */
8153 if (eh->dyn_relocs != NULL && h->root.type == bfd_link_hash_undefweak)
8154 {
8155 if (ELF_ST_VISIBILITY (h->other) != STV_DEFAULT)
8156 eh->dyn_relocs = NULL;
8157
8158 /* Make sure undefined weak symbols are output as a dynamic
8159 symbol in PIEs. */
8160 else if (h->dynindx == -1
8161 && !h->forced_local
8162 && !bfd_elf_link_record_dynamic_symbol (info, h))
8163 return FALSE;
8164 }
8165
8166 }
8167 else if (ELIMINATE_COPY_RELOCS)
8168 {
8169 /* For the non-shared case, discard space for relocs against
8170 symbols which turn out to need copy relocs or are not
8171 dynamic. */
8172
8173 if (!h->non_got_ref
8174 && ((h->def_dynamic
8175 && !h->def_regular)
8176 || (htab->root.dynamic_sections_created
8177 && (h->root.type == bfd_link_hash_undefweak
8178 || h->root.type == bfd_link_hash_undefined))))
8179 {
8180 /* Make sure this symbol is output as a dynamic symbol.
8181 Undefined weak syms won't yet be marked as dynamic. */
8182 if (h->dynindx == -1
8183 && !h->forced_local
8184 && !bfd_elf_link_record_dynamic_symbol (info, h))
8185 return FALSE;
8186
8187 /* If that succeeded, we know we'll be keeping all the
8188 relocs. */
8189 if (h->dynindx != -1)
8190 goto keep;
8191 }
8192
8193 eh->dyn_relocs = NULL;
8194
8195 keep:;
8196 }
8197
8198 /* Finally, allocate space. */
8199 for (p = eh->dyn_relocs; p != NULL; p = p->next)
8200 {
8201 asection *sreloc;
8202
8203 sreloc = elf_section_data (p->sec)->sreloc;
8204
8205 BFD_ASSERT (sreloc != NULL);
8206
8207 sreloc->size += p->count * RELOC_SIZE (htab);
8208 }
8209
8210 return TRUE;
8211}
8212
1419bbe5
WN		 8213/* Allocate space in .plt, .got and associated reloc sections for
8214 ifunc dynamic relocs. */
8215
8216static bfd_boolean
8217elfNN_aarch64_allocate_ifunc_dynrelocs (struct elf_link_hash_entry *h,
8218 void *inf)
8219{
8220 struct bfd_link_info *info;
8221 struct elf_aarch64_link_hash_table *htab;
8222 struct elf_aarch64_link_hash_entry *eh;
8223
8224 /* An example of a bfd_link_hash_indirect symbol is versioned
8225 symbol. For example: __gxx_personality_v0(bfd_link_hash_indirect)
8226 -> __gxx_personality_v0(bfd_link_hash_defined)
8227
8228 There is no need to process bfd_link_hash_indirect symbols here
8229 because we will also be presented with the concrete instance of
8230 the symbol and elfNN_aarch64_copy_indirect_symbol () will have been
8231 called to copy all relevant data from the generic to the concrete
8232 symbol instance.
8233 */
8234 if (h->root.type == bfd_link_hash_indirect)
8235 return TRUE;
8236
8237 if (h->root.type == bfd_link_hash_warning)
8238 h = (struct elf_link_hash_entry *) h->root.u.i.link;
8239
8240 info = (struct bfd_link_info *) inf;
8241 htab = elf_aarch64_hash_table (info);
8242
8243 eh = (struct elf_aarch64_link_hash_entry *) h;
8244
8245 /* Since STT_GNU_IFUNC symbol must go through PLT, we handle it
8246 here if it is defined and referenced in a non-shared object. */
8247 if (h->type == STT_GNU_IFUNC
8248 && h->def_regular)
8249 return _bfd_elf_allocate_ifunc_dyn_relocs (info, h,
8250 &eh->dyn_relocs,
2df3368d 8251 NULL,
1419bbe5
WN		 8252 htab->plt_entry_size,
8253 htab->plt_header_size,
233cc9c1
L		 8254 GOT_ENTRY_SIZE,
8255 FALSE);
1419bbe5
WN		 8256 return TRUE;
8257}
8258
8259/* Allocate space in .plt, .got and associated reloc sections for
8260 local dynamic relocs. */
8261
8262static bfd_boolean
8263elfNN_aarch64_allocate_local_dynrelocs (void **slot, void *inf)
8264{
8265 struct elf_link_hash_entry *h
8266 = (struct elf_link_hash_entry *) *slot;
8267
8268 if (h->type != STT_GNU_IFUNC
8269 || !h->def_regular
8270 || !h->ref_regular
8271 || !h->forced_local
8272 || h->root.type != bfd_link_hash_defined)
8273 abort ();
8274
8275 return elfNN_aarch64_allocate_dynrelocs (h, inf);
8276}
8277
8278/* Allocate space in .plt, .got and associated reloc sections for
8279 local ifunc dynamic relocs. */
8280
8281static bfd_boolean
8282elfNN_aarch64_allocate_local_ifunc_dynrelocs (void **slot, void *inf)
8283{
8284 struct elf_link_hash_entry *h
8285 = (struct elf_link_hash_entry *) *slot;
8286
8287 if (h->type != STT_GNU_IFUNC
8288 || !h->def_regular
8289 || !h->ref_regular
8290 || !h->forced_local
8291 || h->root.type != bfd_link_hash_defined)
8292 abort ();
8293
8294 return elfNN_aarch64_allocate_ifunc_dynrelocs (h, inf);
8295}
a06ea964 8296
c2170589
JW		 8297/* Find any dynamic relocs that apply to read-only sections. */
8298
8299static bfd_boolean
8300aarch64_readonly_dynrelocs (struct elf_link_hash_entry * h, void * inf)
8301{
8302 struct elf_aarch64_link_hash_entry * eh;
8303 struct elf_dyn_relocs * p;
8304
8305 eh = (struct elf_aarch64_link_hash_entry *) h;
8306 for (p = eh->dyn_relocs; p != NULL; p = p->next)
8307 {
8308 asection *s = p->sec;
8309
8310 if (s != NULL && (s->flags & SEC_READONLY) != 0)
8311 {
8312 struct bfd_link_info *info = (struct bfd_link_info *) inf;
8313
8314 info->flags |= DF_TEXTREL;
8315
8316 /* Not an error, just cut short the traversal. */
8317 return FALSE;
8318 }
8319 }
8320 return TRUE;
8321}
8322
a06ea964
NC		 8323/* This is the most important function of all . Innocuosly named
8324 though ! */
8325static bfd_boolean
cec5225b 8326elfNN_aarch64_size_dynamic_sections (bfd *output_bfd ATTRIBUTE_UNUSED,
a06ea964
NC		 8327 struct bfd_link_info *info)
8328{
cec5225b 8329 struct elf_aarch64_link_hash_table *htab;
a06ea964
NC		 8330 bfd *dynobj;
8331 asection *s;
8332 bfd_boolean relocs;
8333 bfd *ibfd;
8334
cec5225b 8335 htab = elf_aarch64_hash_table ((info));
a06ea964
NC		 8336 dynobj = htab->root.dynobj;
8337
8338 BFD_ASSERT (dynobj != NULL);
8339
8340 if (htab->root.dynamic_sections_created)
8341 {
9b8b325a 8342 if (bfd_link_executable (info) && !info->nointerp)
a06ea964
NC		 8343 {
8344 s = bfd_get_linker_section (dynobj, ".interp");
8345 if (s == NULL)
8346 abort ();
8347 s->size = sizeof ELF_DYNAMIC_INTERPRETER;
8348 s->contents = (unsigned char *) ELF_DYNAMIC_INTERPRETER;
8349 }
8350 }
8351
8352 /* Set up .got offsets for local syms, and space for local dynamic
8353 relocs. */
c72f2fb2 8354 for (ibfd = info->input_bfds; ibfd != NULL; ibfd = ibfd->link.next)
a06ea964
NC		 8355 {
8356 struct elf_aarch64_local_symbol *locals = NULL;
8357 Elf_Internal_Shdr *symtab_hdr;
8358 asection *srel;
8359 unsigned int i;
8360
8361 if (!is_aarch64_elf (ibfd))
8362 continue;
8363
8364 for (s = ibfd->sections; s != NULL; s = s->next)
8365 {
8366 struct elf_dyn_relocs *p;
8367
8368 for (p = (struct elf_dyn_relocs *)
8369 (elf_section_data (s)->local_dynrel); p != NULL; p = p->next)
8370 {
8371 if (!bfd_is_abs_section (p->sec)
8372 && bfd_is_abs_section (p->sec->output_section))
8373 {
8374 /* Input section has been discarded, either because
8375 it is a copy of a linkonce section or due to
8376 linker script /DISCARD/, so we'll be discarding
8377 the relocs too. */
8378 }
8379 else if (p->count != 0)
8380 {
8381 srel = elf_section_data (p->sec)->sreloc;
8382 srel->size += p->count * RELOC_SIZE (htab);
8383 if ((p->sec->output_section->flags & SEC_READONLY) != 0)
8384 info->flags |= DF_TEXTREL;
8385 }
8386 }
8387 }
8388
cec5225b 8389 locals = elf_aarch64_locals (ibfd);
a06ea964
NC		 8390 if (!locals)
8391 continue;
8392
8393 symtab_hdr = &elf_symtab_hdr (ibfd);
8394 srel = htab->root.srelgot;
8395 for (i = 0; i < symtab_hdr->sh_info; i++)
8396 {
8397 locals[i].got_offset = (bfd_vma) - 1;
8398 locals[i].tlsdesc_got_jump_table_offset = (bfd_vma) - 1;
8399 if (locals[i].got_refcount > 0)
8400 {
8401 unsigned got_type = locals[i].got_type;
8402 if (got_type & GOT_TLSDESC_GD)
8403 {
8404 locals[i].tlsdesc_got_jump_table_offset =
8405 (htab->root.sgotplt->size
8406 - aarch64_compute_jump_table_size (htab));
8407 htab->root.sgotplt->size += GOT_ENTRY_SIZE * 2;
8408 locals[i].got_offset = (bfd_vma) - 2;
8409 }
8410
8411 if (got_type & GOT_TLS_GD)
8412 {
8413 locals[i].got_offset = htab->root.sgot->size;
8414 htab->root.sgot->size += GOT_ENTRY_SIZE * 2;
8415 }
8416
b53b1bed
JW		 8417 if (got_type & GOT_TLS_IE
8418 || got_type & GOT_NORMAL)
a06ea964
NC		 8419 {
8420 locals[i].got_offset = htab->root.sgot->size;
8421 htab->root.sgot->size += GOT_ENTRY_SIZE;
8422 }
8423
8424 if (got_type == GOT_UNKNOWN)
8425 {
8426 }
8427
0e1862bb 8428 if (bfd_link_pic (info))
a06ea964
NC		 8429 {
8430 if (got_type & GOT_TLSDESC_GD)
8431 {
8432 htab->root.srelplt->size += RELOC_SIZE (htab);
8433 /* Note RELOC_COUNT not incremented here! */
8434 htab->tlsdesc_plt = (bfd_vma) - 1;
8435 }
8436
8437 if (got_type & GOT_TLS_GD)
8438 htab->root.srelgot->size += RELOC_SIZE (htab) * 2;
8439
b53b1bed
JW		 8440 if (got_type & GOT_TLS_IE
8441 || got_type & GOT_NORMAL)
a06ea964
NC		 8442 htab->root.srelgot->size += RELOC_SIZE (htab);
8443 }
8444 }
8445 else
8446 {
8447 locals[i].got_refcount = (bfd_vma) - 1;
8448 }
8449 }
8450 }
8451
8452
8453 /* Allocate global sym .plt and .got entries, and space for global
8454 sym dynamic relocs. */
cec5225b 8455 elf_link_hash_traverse (&htab->root, elfNN_aarch64_allocate_dynrelocs,
a06ea964
NC		 8456 info);
8457
1419bbe5
WN		 8458 /* Allocate global ifunc sym .plt and .got entries, and space for global
8459 ifunc sym dynamic relocs. */
8460 elf_link_hash_traverse (&htab->root, elfNN_aarch64_allocate_ifunc_dynrelocs,
8461 info);
8462
8463 /* Allocate .plt and .got entries, and space for local symbols. */
8464 htab_traverse (htab->loc_hash_table,
8465 elfNN_aarch64_allocate_local_dynrelocs,
8466 info);
8467
8468 /* Allocate .plt and .got entries, and space for local ifunc symbols. */
8469 htab_traverse (htab->loc_hash_table,
8470 elfNN_aarch64_allocate_local_ifunc_dynrelocs,
8471 info);
a06ea964
NC		 8472
8473 /* For every jump slot reserved in the sgotplt, reloc_count is
8474 incremented. However, when we reserve space for TLS descriptors,
8475 it's not incremented, so in order to compute the space reserved
8476 for them, it suffices to multiply the reloc count by the jump
8477 slot size. */
8478
8479 if (htab->root.srelplt)
8847944f 8480 htab->sgotplt_jump_table_size = aarch64_compute_jump_table_size (htab);
a06ea964
NC		 8481
8482 if (htab->tlsdesc_plt)
8483 {
8484 if (htab->root.splt->size == 0)
8485 htab->root.splt->size += PLT_ENTRY_SIZE;
8486
8487 htab->tlsdesc_plt = htab->root.splt->size;
8488 htab->root.splt->size += PLT_TLSDESC_ENTRY_SIZE;
8489
8490 /* If we're not using lazy TLS relocations, don't generate the
8491 GOT entry required. */
8492 if (!(info->flags & DF_BIND_NOW))
8493 {
8494 htab->dt_tlsdesc_got = htab->root.sgot->size;
8495 htab->root.sgot->size += GOT_ENTRY_SIZE;
8496 }
8497 }
8498
68fcca92 8499 /* Init mapping symbols information to use later to distingush between
4106101c
MS		 8500 code and data while scanning for errata. */
8501 if (htab->fix_erratum_835769 || htab->fix_erratum_843419)
68fcca92
JW		 8502 for (ibfd = info->input_bfds; ibfd != NULL; ibfd = ibfd->link.next)
8503 {
8504 if (!is_aarch64_elf (ibfd))
8505 continue;
8506 bfd_elfNN_aarch64_init_maps (ibfd);
8507 }
8508
a06ea964
NC		 8509 /* We now have determined the sizes of the various dynamic sections.
8510 Allocate memory for them. */
8511 relocs = FALSE;
8512 for (s = dynobj->sections; s != NULL; s = s->next)
8513 {
8514 if ((s->flags & SEC_LINKER_CREATED) == 0)
8515 continue;
8516
8517 if (s == htab->root.splt
8518 || s == htab->root.sgot
8519 || s == htab->root.sgotplt
8520 || s == htab->root.iplt
8521 || s == htab->root.igotplt || s == htab->sdynbss)
8522 {
8523 /* Strip this section if we don't need it; see the
8524 comment below. */
8525 }
8526 else if (CONST_STRNEQ (bfd_get_section_name (dynobj, s), ".rela"))
8527 {
8528 if (s->size != 0 && s != htab->root.srelplt)
8529 relocs = TRUE;
8530
8531 /* We use the reloc_count field as a counter if we need
8532 to copy relocs into the output file. */
8533 if (s != htab->root.srelplt)
8534 s->reloc_count = 0;
8535 }
8536 else
8537 {
8538 /* It's not one of our sections, so don't allocate space. */
8539 continue;
8540 }
8541
8542 if (s->size == 0)
8543 {
8544 /* If we don't need this section, strip it from the
8545 output file. This is mostly to handle .rela.bss and
8546 .rela.plt. We must create both sections in
8547 create_dynamic_sections, because they must be created
8548 before the linker maps input sections to output
8549 sections. The linker does that before
8550 adjust_dynamic_symbol is called, and it is that
8551 function which decides whether anything needs to go
8552 into these sections. */
8553
8554 s->flags |= SEC_EXCLUDE;
8555 continue;
8556 }
8557
8558 if ((s->flags & SEC_HAS_CONTENTS) == 0)
8559 continue;
8560
8561 /* Allocate memory for the section contents. We use bfd_zalloc
8562 here in case unused entries are not reclaimed before the
8563 section's contents are written out. This should not happen,
8564 but this way if it does, we get a R_AARCH64_NONE reloc instead
8565 of garbage. */
8566 s->contents = (bfd_byte *) bfd_zalloc (dynobj, s->size);
8567 if (s->contents == NULL)
8568 return FALSE;
8569 }
8570
8571 if (htab->root.dynamic_sections_created)
8572 {
8573 /* Add some entries to the .dynamic section. We fill in the
cec5225b 8574 values later, in elfNN_aarch64_finish_dynamic_sections, but we
a06ea964
NC		 8575 must add the entries now so that we get the correct size for
8576 the .dynamic section. The DT_DEBUG entry is filled in by the
8577 dynamic linker and used by the debugger. */
8578#define add_dynamic_entry(TAG, VAL) \
8579 _bfd_elf_add_dynamic_entry (info, TAG, VAL)
8580
0e1862bb 8581 if (bfd_link_executable (info))
a06ea964
NC		 8582 {
8583 if (!add_dynamic_entry (DT_DEBUG, 0))
8584 return FALSE;
8585 }
8586
8587 if (htab->root.splt->size != 0)
8588 {
8589 if (!add_dynamic_entry (DT_PLTGOT, 0)
8590 || !add_dynamic_entry (DT_PLTRELSZ, 0)
8591 || !add_dynamic_entry (DT_PLTREL, DT_RELA)
8592 || !add_dynamic_entry (DT_JMPREL, 0))
8593 return FALSE;
8594
8595 if (htab->tlsdesc_plt
8596 && (!add_dynamic_entry (DT_TLSDESC_PLT, 0)
8597 || !add_dynamic_entry (DT_TLSDESC_GOT, 0)))
8598 return FALSE;
8599 }
8600
8601 if (relocs)
8602 {
8603 if (!add_dynamic_entry (DT_RELA, 0)
8604 || !add_dynamic_entry (DT_RELASZ, 0)
8605 || !add_dynamic_entry (DT_RELAENT, RELOC_SIZE (htab)))
8606 return FALSE;
8607
8608 /* If any dynamic relocs apply to a read-only section,
8609 then we need a DT_TEXTREL entry. */
c2170589
JW		 8610 if ((info->flags & DF_TEXTREL) == 0)
8611 elf_link_hash_traverse (& htab->root, aarch64_readonly_dynrelocs,
8612 info);
8613
a06ea964
NC		 8614 if ((info->flags & DF_TEXTREL) != 0)
8615 {
8616 if (!add_dynamic_entry (DT_TEXTREL, 0))
8617 return FALSE;
8618 }
8619 }
8620 }
8621#undef add_dynamic_entry
8622
8623 return TRUE;
a06ea964
NC		 8624}
8625
8626static inline void
caed7120
YZ		 8627elf_aarch64_update_plt_entry (bfd *output_bfd,
8628 bfd_reloc_code_real_type r_type,
8629 bfd_byte *plt_entry, bfd_vma value)
a06ea964 8630{
caed7120
YZ		 8631 reloc_howto_type *howto = elfNN_aarch64_howto_from_bfd_reloc (r_type);
8632
8633 _bfd_aarch64_elf_put_addend (output_bfd, plt_entry, r_type, howto, value);
a06ea964
NC		 8634}
8635
8636static void
cec5225b
YZ		 8637elfNN_aarch64_create_small_pltn_entry (struct elf_link_hash_entry *h,
8638 struct elf_aarch64_link_hash_table
1419bbe5
WN		 8639 *htab, bfd *output_bfd,
8640 struct bfd_link_info *info)
a06ea964
NC		 8641{
8642 bfd_byte *plt_entry;
8643 bfd_vma plt_index;
8644 bfd_vma got_offset;
8645 bfd_vma gotplt_entry_address;
8646 bfd_vma plt_entry_address;
8647 Elf_Internal_Rela rela;
8648 bfd_byte *loc;
1419bbe5
WN		 8649 asection *plt, *gotplt, *relplt;
8650
8651 /* When building a static executable, use .iplt, .igot.plt and
8652 .rela.iplt sections for STT_GNU_IFUNC symbols. */
8653 if (htab->root.splt != NULL)
8654 {
8655 plt = htab->root.splt;
8656 gotplt = htab->root.sgotplt;
8657 relplt = htab->root.srelplt;
8658 }
8659 else
8660 {
8661 plt = htab->root.iplt;
8662 gotplt = htab->root.igotplt;
8663 relplt = htab->root.irelplt;
8664 }
8665
8666 /* Get the index in the procedure linkage table which
8667 corresponds to this symbol. This is the index of this symbol
8668 in all the symbols for which we are making plt entries. The
8669 first entry in the procedure linkage table is reserved.
a06ea964 8670
1419bbe5
WN		 8671 Get the offset into the .got table of the entry that
8672 corresponds to this function. Each .got entry is GOT_ENTRY_SIZE
8673 bytes. The first three are reserved for the dynamic linker.
692e2b8b 8674
1419bbe5
WN		 8675 For static executables, we don't reserve anything. */
8676
8677 if (plt == htab->root.splt)
8678 {
8679 plt_index = (h->plt.offset - htab->plt_header_size) / htab->plt_entry_size;
8680 got_offset = (plt_index + 3) * GOT_ENTRY_SIZE;
8681 }
8682 else
8683 {
8684 plt_index = h->plt.offset / htab->plt_entry_size;
8685 got_offset = plt_index * GOT_ENTRY_SIZE;
8686 }
8687
8688 plt_entry = plt->contents + h->plt.offset;
8689 plt_entry_address = plt->output_section->vma
f44a1f8e 8690 + plt->output_offset + h->plt.offset;
1419bbe5
WN		 8691 gotplt_entry_address = gotplt->output_section->vma +
8692 gotplt->output_offset + got_offset;
a06ea964
NC		 8693
8694 /* Copy in the boiler-plate for the PLTn entry. */
cec5225b 8695 memcpy (plt_entry, elfNN_aarch64_small_plt_entry, PLT_SMALL_ENTRY_SIZE);
a06ea964
NC		 8696
8697 /* Fill in the top 21 bits for this: ADRP x16, PLT_GOT + n * 8.
8698 ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
caed7120
YZ		 8699 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADR_HI21_PCREL,
8700 plt_entry,
8701 PG (gotplt_entry_address) -
8702 PG (plt_entry_address));
a06ea964
NC		 8703
8704 /* Fill in the lo12 bits for the load from the pltgot. */
caed7120
YZ		 8705 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_LDSTNN_LO12,
8706 plt_entry + 4,
8707 PG_OFFSET (gotplt_entry_address));
a06ea964 8708
9aff4b7a 8709 /* Fill in the lo12 bits for the add from the pltgot entry. */
caed7120
YZ		 8710 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADD_LO12,
8711 plt_entry + 8,
8712 PG_OFFSET (gotplt_entry_address));
a06ea964
NC		 8713
8714 /* All the GOTPLT Entries are essentially initialized to PLT0. */
cec5225b 8715 bfd_put_NN (output_bfd,
1419bbe5
WN		 8716 plt->output_section->vma + plt->output_offset,
8717 gotplt->contents + got_offset);
a06ea964 8718
a06ea964 8719 rela.r_offset = gotplt_entry_address;
1419bbe5
WN		 8720
8721 if (h->dynindx == -1
0e1862bb 8722 || ((bfd_link_executable (info)
1419bbe5
WN		 8723 || ELF_ST_VISIBILITY (h->other) != STV_DEFAULT)
8724 && h->def_regular
8725 && h->type == STT_GNU_IFUNC))
8726 {
8727 /* If an STT_GNU_IFUNC symbol is locally defined, generate
8728 R_AARCH64_IRELATIVE instead of R_AARCH64_JUMP_SLOT. */
8729 rela.r_info = ELFNN_R_INFO (0, AARCH64_R (IRELATIVE));
8730 rela.r_addend = (h->root.u.def.value
8731 + h->root.u.def.section->output_section->vma
8732 + h->root.u.def.section->output_offset);
8733 }
8734 else
8735 {
8736 /* Fill in the entry in the .rela.plt section. */
8737 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (JUMP_SLOT));
8738 rela.r_addend = 0;
8739 }
a06ea964
NC		 8740
8741 /* Compute the relocation entry to used based on PLT index and do
8742 not adjust reloc_count. The reloc_count has already been adjusted
8743 to account for this entry. */
1419bbe5 8744 loc = relplt->contents + plt_index * RELOC_SIZE (htab);
cec5225b 8745 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964
NC		 8746}
8747
8748/* Size sections even though they're not dynamic. We use it to setup
8749 _TLS_MODULE_BASE_, if needed. */
8750
8751static bfd_boolean
cec5225b 8752elfNN_aarch64_always_size_sections (bfd *output_bfd,
a06ea964
NC		 8753 struct bfd_link_info *info)
8754{
8755 asection *tls_sec;
8756
0e1862bb 8757 if (bfd_link_relocatable (info))
a06ea964
NC		 8758 return TRUE;
8759
8760 tls_sec = elf_hash_table (info)->tls_sec;
8761
8762 if (tls_sec)
8763 {
8764 struct elf_link_hash_entry *tlsbase;
8765
8766 tlsbase = elf_link_hash_lookup (elf_hash_table (info),
8767 "_TLS_MODULE_BASE_", TRUE, TRUE, FALSE);
8768
8769 if (tlsbase)
8770 {
8771 struct bfd_link_hash_entry *h = NULL;
8772 const struct elf_backend_data *bed =
8773 get_elf_backend_data (output_bfd);
8774
8775 if (!(_bfd_generic_link_add_one_symbol
8776 (info, output_bfd, "_TLS_MODULE_BASE_", BSF_LOCAL,
8777 tls_sec, 0, NULL, FALSE, bed->collect, &h)))
8778 return FALSE;
8779
8780 tlsbase->type = STT_TLS;
8781 tlsbase = (struct elf_link_hash_entry *) h;
8782 tlsbase->def_regular = 1;
8783 tlsbase->other = STV_HIDDEN;
8784 (*bed->elf_backend_hide_symbol) (info, tlsbase, TRUE);
8785 }
8786 }
8787
8788 return TRUE;
8789}
8790
8791/* Finish up dynamic symbol handling. We set the contents of various
8792 dynamic sections here. */
8793static bfd_boolean
cec5225b 8794elfNN_aarch64_finish_dynamic_symbol (bfd *output_bfd,
a06ea964
NC		 8795 struct bfd_link_info *info,
8796 struct elf_link_hash_entry *h,
8797 Elf_Internal_Sym *sym)
8798{
cec5225b
YZ		 8799 struct elf_aarch64_link_hash_table *htab;
8800 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 8801
8802 if (h->plt.offset != (bfd_vma) - 1)
8803 {
1419bbe5
WN		 8804 asection *plt, *gotplt, *relplt;
8805
a06ea964
NC		 8806 /* This symbol has an entry in the procedure linkage table. Set
8807 it up. */
8808
1419bbe5
WN		 8809 /* When building a static executable, use .iplt, .igot.plt and
8810 .rela.iplt sections for STT_GNU_IFUNC symbols. */
8811 if (htab->root.splt != NULL)
8812 {
8813 plt = htab->root.splt;
8814 gotplt = htab->root.sgotplt;
8815 relplt = htab->root.srelplt;
8816 }
8817 else
8818 {
8819 plt = htab->root.iplt;
8820 gotplt = htab->root.igotplt;
8821 relplt = htab->root.irelplt;
8822 }
8823
8824 /* This symbol has an entry in the procedure linkage table. Set
8825 it up. */
8826 if ((h->dynindx == -1
0e1862bb 8827 && !((h->forced_local || bfd_link_executable (info))
1419bbe5
WN		 8828 && h->def_regular
8829 && h->type == STT_GNU_IFUNC))
8830 || plt == NULL
8831 || gotplt == NULL
8832 || relplt == NULL)
a06ea964
NC		 8833 abort ();
8834
1419bbe5 8835 elfNN_aarch64_create_small_pltn_entry (h, htab, output_bfd, info);
a06ea964
NC		 8836 if (!h->def_regular)
8837 {
8838 /* Mark the symbol as undefined, rather than as defined in
46b87d49 8839 the .plt section. */
a06ea964 8840 sym->st_shndx = SHN_UNDEF;
46b87d49
WN		 8841 /* If the symbol is weak we need to clear the value.
8842 Otherwise, the PLT entry would provide a definition for
8843 the symbol even if the symbol wasn't defined anywhere,
8844 and so the symbol would never be NULL. Leave the value if
8845 there were any relocations where pointer equality matters
8846 (this is a clue for the dynamic linker, to make function
8847 pointer comparisons work between an application and shared
8848 library). */
8849 if (!h->ref_regular_nonweak || !h->pointer_equality_needed)
8850 sym->st_value = 0;
a06ea964
NC		 8851 }
8852 }
8853
8854 if (h->got.offset != (bfd_vma) - 1
cec5225b 8855 && elf_aarch64_hash_entry (h)->got_type == GOT_NORMAL)
a06ea964
NC		 8856 {
8857 Elf_Internal_Rela rela;
8858 bfd_byte *loc;
8859
8860 /* This symbol has an entry in the global offset table. Set it
8861 up. */
8862 if (htab->root.sgot == NULL || htab->root.srelgot == NULL)
8863 abort ();
8864
8865 rela.r_offset = (htab->root.sgot->output_section->vma
8866 + htab->root.sgot->output_offset
8867 + (h->got.offset & ~(bfd_vma) 1));
8868
49206388
WN		 8869 if (h->def_regular
8870 && h->type == STT_GNU_IFUNC)
8871 {
0e1862bb 8872 if (bfd_link_pic (info))
49206388
WN		 8873 {
8874 /* Generate R_AARCH64_GLOB_DAT. */
8875 goto do_glob_dat;
8876 }
8877 else
8878 {
8879 asection *plt;
8880
8881 if (!h->pointer_equality_needed)
8882 abort ();
8883
8884 /* For non-shared object, we can't use .got.plt, which
8885 contains the real function address if we need pointer
8886 equality. We load the GOT entry with the PLT entry. */
8887 plt = htab->root.splt ? htab->root.splt : htab->root.iplt;
8888 bfd_put_NN (output_bfd, (plt->output_section->vma
8889 + plt->output_offset
8890 + h->plt.offset),
8891 htab->root.sgot->contents
8892 + (h->got.offset & ~(bfd_vma) 1));
8893 return TRUE;
8894 }
8895 }
0e1862bb 8896 else if (bfd_link_pic (info) && SYMBOL_REFERENCES_LOCAL (info, h))
a06ea964
NC		 8897 {
8898 if (!h->def_regular)
8899 return FALSE;
8900
8901 BFD_ASSERT ((h->got.offset & 1) != 0);
a6bb11b2 8902 rela.r_info = ELFNN_R_INFO (0, AARCH64_R (RELATIVE));
a06ea964
NC		 8903 rela.r_addend = (h->root.u.def.value
8904 + h->root.u.def.section->output_section->vma
8905 + h->root.u.def.section->output_offset);
8906 }
8907 else
8908 {
49206388 8909do_glob_dat:
a06ea964 8910 BFD_ASSERT ((h->got.offset & 1) == 0);
cec5225b 8911 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964 8912 htab->root.sgot->contents + h->got.offset);
a6bb11b2 8913 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (GLOB_DAT));
a06ea964
NC		 8914 rela.r_addend = 0;
8915 }
8916
8917 loc = htab->root.srelgot->contents;
8918 loc += htab->root.srelgot->reloc_count++ * RELOC_SIZE (htab);
cec5225b 8919 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964
NC		 8920 }
8921
8922 if (h->needs_copy)
8923 {
8924 Elf_Internal_Rela rela;
8925 bfd_byte *loc;
8926
8927 /* This symbol needs a copy reloc. Set it up. */
8928
8929 if (h->dynindx == -1
8930 || (h->root.type != bfd_link_hash_defined
8931 && h->root.type != bfd_link_hash_defweak)
8932 || htab->srelbss == NULL)
8933 abort ();
8934
8935 rela.r_offset = (h->root.u.def.value
8936 + h->root.u.def.section->output_section->vma
8937 + h->root.u.def.section->output_offset);
a6bb11b2 8938 rela.r_info = ELFNN_R_INFO (h->dynindx, AARCH64_R (COPY));
a06ea964
NC		 8939 rela.r_addend = 0;
8940 loc = htab->srelbss->contents;
8941 loc += htab->srelbss->reloc_count++ * RELOC_SIZE (htab);
cec5225b 8942 bfd_elfNN_swap_reloca_out (output_bfd, &rela, loc);
a06ea964
NC		 8943 }
8944
8945 /* Mark _DYNAMIC and _GLOBAL_OFFSET_TABLE_ as absolute. SYM may
8946 be NULL for local symbols. */
8947 if (sym != NULL
9637f6ef 8948 && (h == elf_hash_table (info)->hdynamic
a06ea964
NC		 8949 || h == elf_hash_table (info)->hgot))
8950 sym->st_shndx = SHN_ABS;
8951
8952 return TRUE;
8953}
8954
1419bbe5
WN		 8955/* Finish up local dynamic symbol handling. We set the contents of
8956 various dynamic sections here. */
8957
8958static bfd_boolean
8959elfNN_aarch64_finish_local_dynamic_symbol (void **slot, void *inf)
8960{
8961 struct elf_link_hash_entry *h
8962 = (struct elf_link_hash_entry *) *slot;
8963 struct bfd_link_info *info
8964 = (struct bfd_link_info *) inf;
8965
8966 return elfNN_aarch64_finish_dynamic_symbol (info->output_bfd,
8967 info, h, NULL);
8968}
8969
a06ea964 8970static void
cec5225b
YZ		 8971elfNN_aarch64_init_small_plt0_entry (bfd *output_bfd ATTRIBUTE_UNUSED,
8972 struct elf_aarch64_link_hash_table
a06ea964
NC		 8973 *htab)
8974{
8975 /* Fill in PLT0. Fixme:RR Note this doesn't distinguish between
8976 small and large plts and at the minute just generates
8977 the small PLT. */
8978
cec5225b 8979 /* PLT0 of the small PLT looks like this in ELF64 -
a06ea964
NC		 8980 stp x16, x30, [sp, #-16]! // Save the reloc and lr on stack.
8981 adrp x16, PLT_GOT + 16 // Get the page base of the GOTPLT
8982 ldr x17, [x16, #:lo12:PLT_GOT+16] // Load the address of the
8983 // symbol resolver
8984 add x16, x16, #:lo12:PLT_GOT+16 // Load the lo12 bits of the
8985 // GOTPLT entry for this.
8986 br x17
cec5225b
YZ		 8987 PLT0 will be slightly different in ELF32 due to different got entry
8988 size.
a06ea964 8989 */
caed7120 8990 bfd_vma plt_got_2nd_ent; /* Address of GOT[2]. */
a06ea964
NC		 8991 bfd_vma plt_base;
8992
8993
cec5225b 8994 memcpy (htab->root.splt->contents, elfNN_aarch64_small_plt0_entry,
a06ea964
NC		 8995 PLT_ENTRY_SIZE);
8996 elf_section_data (htab->root.splt->output_section)->this_hdr.sh_entsize =
8997 PLT_ENTRY_SIZE;
8998
caed7120
YZ		 8999 plt_got_2nd_ent = (htab->root.sgotplt->output_section->vma
9000 + htab->root.sgotplt->output_offset
9001 + GOT_ENTRY_SIZE * 2);
a06ea964
NC		 9002
9003 plt_base = htab->root.splt->output_section->vma +
f44a1f8e 9004 htab->root.splt->output_offset;
a06ea964
NC		 9005
9006 /* Fill in the top 21 bits for this: ADRP x16, PLT_GOT + n * 8.
9007 ADRP: ((PG(S+A)-PG(P)) >> 12) & 0x1fffff */
caed7120
YZ		 9008 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADR_HI21_PCREL,
9009 htab->root.splt->contents + 4,
9010 PG (plt_got_2nd_ent) - PG (plt_base + 4));
a06ea964 9011
caed7120
YZ		 9012 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_LDSTNN_LO12,
9013 htab->root.splt->contents + 8,
9014 PG_OFFSET (plt_got_2nd_ent));
a06ea964 9015
caed7120
YZ		 9016 elf_aarch64_update_plt_entry (output_bfd, BFD_RELOC_AARCH64_ADD_LO12,
9017 htab->root.splt->contents + 12,
9018 PG_OFFSET (plt_got_2nd_ent));
a06ea964
NC		 9019}
9020
9021static bfd_boolean
cec5225b 9022elfNN_aarch64_finish_dynamic_sections (bfd *output_bfd,
a06ea964
NC		 9023 struct bfd_link_info *info)
9024{
cec5225b 9025 struct elf_aarch64_link_hash_table *htab;
a06ea964
NC		 9026 bfd *dynobj;
9027 asection *sdyn;
9028
cec5225b 9029 htab = elf_aarch64_hash_table (info);
a06ea964
NC		 9030 dynobj = htab->root.dynobj;
9031 sdyn = bfd_get_linker_section (dynobj, ".dynamic");
9032
9033 if (htab->root.dynamic_sections_created)
9034 {
cec5225b 9035 ElfNN_External_Dyn *dyncon, *dynconend;
a06ea964
NC		 9036
9037 if (sdyn == NULL || htab->root.sgot == NULL)
9038 abort ();
9039
cec5225b
YZ		 9040 dyncon = (ElfNN_External_Dyn *) sdyn->contents;
9041 dynconend = (ElfNN_External_Dyn *) (sdyn->contents + sdyn->size);
a06ea964
NC		 9042 for (; dyncon < dynconend; dyncon++)
9043 {
9044 Elf_Internal_Dyn dyn;
9045 asection *s;
9046
cec5225b 9047 bfd_elfNN_swap_dyn_in (dynobj, dyncon, &dyn);
a06ea964
NC		 9048
9049 switch (dyn.d_tag)
9050 {
9051 default:
9052 continue;
9053
9054 case DT_PLTGOT:
9055 s = htab->root.sgotplt;
9056 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset;
9057 break;
9058
9059 case DT_JMPREL:
4ade44b7
AM		 9060 s = htab->root.srelplt;
9061 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset;
a06ea964
NC		 9062 break;
9063
9064 case DT_PLTRELSZ:
c955de36 9065 s = htab->root.srelplt;
a06ea964
NC		 9066 dyn.d_un.d_val = s->size;
9067 break;
9068
9069 case DT_RELASZ:
9070 /* The procedure linkage table relocs (DT_JMPREL) should
9071 not be included in the overall relocs (DT_RELA).
9072 Therefore, we override the DT_RELASZ entry here to
9073 make it not include the JMPREL relocs. Since the
9074 linker script arranges for .rela.plt to follow all
9075 other relocation sections, we don't have to worry
9076 about changing the DT_RELA entry. */
9077 if (htab->root.srelplt != NULL)
9078 {
c955de36 9079 s = htab->root.srelplt;
a06ea964
NC		 9080 dyn.d_un.d_val -= s->size;
9081 }
9082 break;
9083
9084 case DT_TLSDESC_PLT:
9085 s = htab->root.splt;
9086 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset
9087 + htab->tlsdesc_plt;
9088 break;
9089
9090 case DT_TLSDESC_GOT:
9091 s = htab->root.sgot;
9092 dyn.d_un.d_ptr = s->output_section->vma + s->output_offset
9093 + htab->dt_tlsdesc_got;
9094 break;
9095 }
9096
cec5225b 9097 bfd_elfNN_swap_dyn_out (output_bfd, &dyn, dyncon);
a06ea964
NC		 9098 }
9099
9100 }
9101
9102 /* Fill in the special first entry in the procedure linkage table. */
9103 if (htab->root.splt && htab->root.splt->size > 0)
9104 {
cec5225b 9105 elfNN_aarch64_init_small_plt0_entry (output_bfd, htab);
a06ea964
NC		 9106
9107 elf_section_data (htab->root.splt->output_section)->
9108 this_hdr.sh_entsize = htab->plt_entry_size;
9109
9110
9111 if (htab->tlsdesc_plt)
9112 {
cec5225b 9113 bfd_put_NN (output_bfd, (bfd_vma) 0,
a06ea964
NC		 9114 htab->root.sgot->contents + htab->dt_tlsdesc_got);
9115
9116 memcpy (htab->root.splt->contents + htab->tlsdesc_plt,
cec5225b
YZ		 9117 elfNN_aarch64_tlsdesc_small_plt_entry,
9118 sizeof (elfNN_aarch64_tlsdesc_small_plt_entry));
a06ea964
NC		 9119
9120 {
9121 bfd_vma adrp1_addr =
9122 htab->root.splt->output_section->vma
9123 + htab->root.splt->output_offset + htab->tlsdesc_plt + 4;
9124
caed7120 9125 bfd_vma adrp2_addr = adrp1_addr + 4;
a06ea964
NC		 9126
9127 bfd_vma got_addr =
9128 htab->root.sgot->output_section->vma
9129 + htab->root.sgot->output_offset;
9130
9131 bfd_vma pltgot_addr =
9132 htab->root.sgotplt->output_section->vma
9133 + htab->root.sgotplt->output_offset;
9134
9135 bfd_vma dt_tlsdesc_got = got_addr + htab->dt_tlsdesc_got;
caed7120
YZ		 9136
9137 bfd_byte *plt_entry =
9138 htab->root.splt->contents + htab->tlsdesc_plt;
a06ea964
NC		 9139
9140 /* adrp x2, DT_TLSDESC_GOT */
caed7120
YZ		 9141 elf_aarch64_update_plt_entry (output_bfd,
9142 BFD_RELOC_AARCH64_ADR_HI21_PCREL,
9143 plt_entry + 4,
9144 (PG (dt_tlsdesc_got)
9145 - PG (adrp1_addr)));
a06ea964
NC		 9146
9147 /* adrp x3, 0 */
caed7120
YZ		 9148 elf_aarch64_update_plt_entry (output_bfd,
9149 BFD_RELOC_AARCH64_ADR_HI21_PCREL,
9150 plt_entry + 8,
9151 (PG (pltgot_addr)
9152 - PG (adrp2_addr)));
a06ea964
NC		 9153
9154 /* ldr x2, [x2, #0] */
caed7120
YZ		 9155 elf_aarch64_update_plt_entry (output_bfd,
9156 BFD_RELOC_AARCH64_LDSTNN_LO12,
9157 plt_entry + 12,
9158 PG_OFFSET (dt_tlsdesc_got));
a06ea964
NC		 9159
9160 /* add x3, x3, 0 */
caed7120
YZ		 9161 elf_aarch64_update_plt_entry (output_bfd,
9162 BFD_RELOC_AARCH64_ADD_LO12,
9163 plt_entry + 16,
9164 PG_OFFSET (pltgot_addr));
a06ea964
NC		 9165 }
9166 }
9167 }
9168
9169 if (htab->root.sgotplt)
9170 {
9171 if (bfd_is_abs_section (htab->root.sgotplt->output_section))
9172 {
4eca0228 9173 _bfd_error_handler
a06ea964
NC		 9174 (_("discarded output section: `%A'"), htab->root.sgotplt);
9175 return FALSE;
9176 }
9177
9178 /* Fill in the first three entries in the global offset table. */
9179 if (htab->root.sgotplt->size > 0)
9180 {
8db339a6
MS		 9181 bfd_put_NN (output_bfd, (bfd_vma) 0, htab->root.sgotplt->contents);
9182
a06ea964 9183 /* Write GOT[1] and GOT[2], needed for the dynamic linker. */
cec5225b 9184 bfd_put_NN (output_bfd,
a06ea964
NC		 9185 (bfd_vma) 0,
9186 htab->root.sgotplt->contents + GOT_ENTRY_SIZE);
cec5225b 9187 bfd_put_NN (output_bfd,
a06ea964
NC		 9188 (bfd_vma) 0,
9189 htab->root.sgotplt->contents + GOT_ENTRY_SIZE * 2);
9190 }
9191
8db339a6
MS		 9192 if (htab->root.sgot)
9193 {
9194 if (htab->root.sgot->size > 0)
9195 {
9196 bfd_vma addr =
9197 sdyn ? sdyn->output_section->vma + sdyn->output_offset : 0;
9198 bfd_put_NN (output_bfd, addr, htab->root.sgot->contents);
9199 }
9200 }
9201
a06ea964
NC		 9202 elf_section_data (htab->root.sgotplt->output_section)->
9203 this_hdr.sh_entsize = GOT_ENTRY_SIZE;
9204 }
9205
9206 if (htab->root.sgot && htab->root.sgot->size > 0)
9207 elf_section_data (htab->root.sgot->output_section)->this_hdr.sh_entsize
9208 = GOT_ENTRY_SIZE;
9209
1419bbe5
WN		 9210 /* Fill PLT and GOT entries for local STT_GNU_IFUNC symbols. */
9211 htab_traverse (htab->loc_hash_table,
9212 elfNN_aarch64_finish_local_dynamic_symbol,
9213 info);
9214
a06ea964
NC		 9215 return TRUE;
9216}
9217
9218/* Return address for Ith PLT stub in section PLT, for relocation REL
9219 or (bfd_vma) -1 if it should not be included. */
9220
9221static bfd_vma
cec5225b 9222elfNN_aarch64_plt_sym_val (bfd_vma i, const asection *plt,
a06ea964
NC		 9223 const arelent *rel ATTRIBUTE_UNUSED)
9224{
9225 return plt->vma + PLT_ENTRY_SIZE + i * PLT_SMALL_ENTRY_SIZE;
9226}
9227
d691934d
NC		 9228/* Returns TRUE if NAME is an AArch64 mapping symbol.
9229 The ARM ELF standard defines $x (for A64 code) and $d (for data).
9230 It also allows a period initiated suffix to be added to the symbol, ie:
9231 "$[adtx]\.[:sym_char]+". */
9232
9233static bfd_boolean
9234is_aarch64_mapping_symbol (const char * name)
9235{
9236 return name != NULL /* Paranoia. */
9237 && name[0] == '$' /* Note: if objcopy --prefix-symbols has been used then
9238 the mapping symbols could have acquired a prefix.
9239 We do not support this here, since such symbols no
9240 longer conform to the ARM ELF ABI. */
9241 && (name[1] == 'd' || name[1] == 'x')
9242 && (name[2] == 0 || name[2] == '.');
9243 /* FIXME: Strictly speaking the symbol is only a valid mapping symbol if
9244 any characters that follow the period are legal characters for the body
9245 of a symbol's name. For now we just assume that this is the case. */
9246}
9247
9248/* Make sure that mapping symbols in object files are not removed via the
9249 "strip --strip-unneeded" tool. These symbols might needed in order to
9250 correctly generate linked files. Once an object file has been linked,
9251 it should be safe to remove them. */
9252
9253static void
9254elfNN_aarch64_backend_symbol_processing (bfd *abfd, asymbol *sym)
9255{
9256 if (((abfd->flags & (EXEC_P | DYNAMIC)) == 0)
9257 && sym->section != bfd_abs_section_ptr
9258 && is_aarch64_mapping_symbol (sym->name))
9259 sym->flags |= BSF_KEEP;
9260}
9261
a06ea964
NC		 9262
9263/* We use this so we can override certain functions
9264 (though currently we don't). */
9265
cec5225b 9266const struct elf_size_info elfNN_aarch64_size_info =
a06ea964 9267{
cec5225b
YZ		 9268 sizeof (ElfNN_External_Ehdr),
9269 sizeof (ElfNN_External_Phdr),
9270 sizeof (ElfNN_External_Shdr),
9271 sizeof (ElfNN_External_Rel),
9272 sizeof (ElfNN_External_Rela),
9273 sizeof (ElfNN_External_Sym),
9274 sizeof (ElfNN_External_Dyn),
a06ea964
NC		 9275 sizeof (Elf_External_Note),
9276 4, /* Hash table entry size. */
9277 1, /* Internal relocs per external relocs. */
cec5225b
YZ		 9278 ARCH_SIZE, /* Arch size. */
9279 LOG_FILE_ALIGN, /* Log_file_align. */
9280 ELFCLASSNN, EV_CURRENT,
9281 bfd_elfNN_write_out_phdrs,
9282 bfd_elfNN_write_shdrs_and_ehdr,
9283 bfd_elfNN_checksum_contents,
9284 bfd_elfNN_write_relocs,
9285 bfd_elfNN_swap_symbol_in,
9286 bfd_elfNN_swap_symbol_out,
9287 bfd_elfNN_slurp_reloc_table,
9288 bfd_elfNN_slurp_symbol_table,
9289 bfd_elfNN_swap_dyn_in,
9290 bfd_elfNN_swap_dyn_out,
9291 bfd_elfNN_swap_reloc_in,
9292 bfd_elfNN_swap_reloc_out,
9293 bfd_elfNN_swap_reloca_in,
9294 bfd_elfNN_swap_reloca_out
a06ea964
NC		 9295};
9296
9297#define ELF_ARCH bfd_arch_aarch64
9298#define ELF_MACHINE_CODE EM_AARCH64
9299#define ELF_MAXPAGESIZE 0x10000
9300#define ELF_MINPAGESIZE 0x1000
9301#define ELF_COMMONPAGESIZE 0x1000
9302
cec5225b
YZ		 9303#define bfd_elfNN_close_and_cleanup \
9304 elfNN_aarch64_close_and_cleanup
a06ea964 9305
cec5225b
YZ		 9306#define bfd_elfNN_bfd_free_cached_info \
9307 elfNN_aarch64_bfd_free_cached_info
a06ea964 9308
cec5225b
YZ		 9309#define bfd_elfNN_bfd_is_target_special_symbol \
9310 elfNN_aarch64_is_target_special_symbol
a06ea964 9311
cec5225b
YZ		 9312#define bfd_elfNN_bfd_link_hash_table_create \
9313 elfNN_aarch64_link_hash_table_create
a06ea964 9314
cec5225b
YZ		 9315#define bfd_elfNN_bfd_merge_private_bfd_data \
9316 elfNN_aarch64_merge_private_bfd_data
a06ea964 9317
cec5225b
YZ		 9318#define bfd_elfNN_bfd_print_private_bfd_data \
9319 elfNN_aarch64_print_private_bfd_data
a06ea964 9320
cec5225b
YZ		 9321#define bfd_elfNN_bfd_reloc_type_lookup \
9322 elfNN_aarch64_reloc_type_lookup
a06ea964 9323
cec5225b
YZ		 9324#define bfd_elfNN_bfd_reloc_name_lookup \
9325 elfNN_aarch64_reloc_name_lookup
a06ea964 9326
cec5225b
YZ		 9327#define bfd_elfNN_bfd_set_private_flags \
9328 elfNN_aarch64_set_private_flags
a06ea964 9329
cec5225b
YZ		 9330#define bfd_elfNN_find_inliner_info \
9331 elfNN_aarch64_find_inliner_info
a06ea964 9332
cec5225b
YZ		 9333#define bfd_elfNN_find_nearest_line \
9334 elfNN_aarch64_find_nearest_line
a06ea964 9335
cec5225b
YZ		 9336#define bfd_elfNN_mkobject \
9337 elfNN_aarch64_mkobject
a06ea964 9338
cec5225b
YZ		 9339#define bfd_elfNN_new_section_hook \
9340 elfNN_aarch64_new_section_hook
a06ea964
NC		 9341
9342#define elf_backend_adjust_dynamic_symbol \
cec5225b 9343 elfNN_aarch64_adjust_dynamic_symbol
a06ea964
NC		 9344
9345#define elf_backend_always_size_sections \
cec5225b 9346 elfNN_aarch64_always_size_sections
a06ea964
NC		 9347
9348#define elf_backend_check_relocs \
cec5225b 9349 elfNN_aarch64_check_relocs
a06ea964
NC		 9350
9351#define elf_backend_copy_indirect_symbol \
cec5225b 9352 elfNN_aarch64_copy_indirect_symbol
a06ea964
NC		 9353
9354/* Create .dynbss, and .rela.bss sections in DYNOBJ, and set up shortcuts
9355 to them in our hash. */
9356#define elf_backend_create_dynamic_sections \
cec5225b 9357 elfNN_aarch64_create_dynamic_sections
a06ea964
NC		 9358
9359#define elf_backend_init_index_section \
9360 _bfd_elf_init_2_index_sections
9361
a06ea964 9362#define elf_backend_finish_dynamic_sections \
cec5225b 9363 elfNN_aarch64_finish_dynamic_sections
a06ea964
NC		 9364
9365#define elf_backend_finish_dynamic_symbol \
cec5225b 9366 elfNN_aarch64_finish_dynamic_symbol
a06ea964
NC		 9367
9368#define elf_backend_gc_sweep_hook \
cec5225b 9369 elfNN_aarch64_gc_sweep_hook
a06ea964
NC		 9370
9371#define elf_backend_object_p \
cec5225b 9372 elfNN_aarch64_object_p
a06ea964
NC		 9373
9374#define elf_backend_output_arch_local_syms \
cec5225b 9375 elfNN_aarch64_output_arch_local_syms
a06ea964
NC		 9376
9377#define elf_backend_plt_sym_val \
cec5225b 9378 elfNN_aarch64_plt_sym_val
a06ea964
NC		 9379
9380#define elf_backend_post_process_headers \
cec5225b 9381 elfNN_aarch64_post_process_headers
a06ea964
NC		 9382
9383#define elf_backend_relocate_section \
cec5225b 9384 elfNN_aarch64_relocate_section
a06ea964
NC		 9385
9386#define elf_backend_reloc_type_class \
cec5225b 9387 elfNN_aarch64_reloc_type_class
a06ea964 9388
a06ea964 9389#define elf_backend_section_from_shdr \
cec5225b 9390 elfNN_aarch64_section_from_shdr
a06ea964
NC		 9391
9392#define elf_backend_size_dynamic_sections \
cec5225b 9393 elfNN_aarch64_size_dynamic_sections
a06ea964
NC		 9394
9395#define elf_backend_size_info \
cec5225b 9396 elfNN_aarch64_size_info
a06ea964 9397
68fcca92
JW		 9398#define elf_backend_write_section \
9399 elfNN_aarch64_write_section
9400
d691934d
NC		 9401#define elf_backend_symbol_processing \
9402 elfNN_aarch64_backend_symbol_processing
9403
a06ea964 9404#define elf_backend_can_refcount 1
59c108f7 9405#define elf_backend_can_gc_sections 1
a06ea964
NC		 9406#define elf_backend_plt_readonly 1
9407#define elf_backend_want_got_plt 1
9408#define elf_backend_want_plt_sym 0
9409#define elf_backend_may_use_rel_p 0
9410#define elf_backend_may_use_rela_p 1
9411#define elf_backend_default_use_rela_p 1
2e0488d3 9412#define elf_backend_rela_normal 1
a06ea964 9413#define elf_backend_got_header_size (GOT_ENTRY_SIZE * 3)
c495064d 9414#define elf_backend_default_execstack 0
32f573bc 9415#define elf_backend_extern_protected_data 1
a06ea964
NC		 9416
9417#undef elf_backend_obj_attrs_section
9418#define elf_backend_obj_attrs_section ".ARM.attributes"
9419
cec5225b 9420#include "elfNN-target.h"
a75cf613
ES		 9421
9422/* CloudABI support. */
9423
9424#undef TARGET_LITTLE_SYM
9425#define TARGET_LITTLE_SYM aarch64_elfNN_le_cloudabi_vec
9426#undef TARGET_LITTLE_NAME
9427#define TARGET_LITTLE_NAME "elfNN-littleaarch64-cloudabi"
9428#undef TARGET_BIG_SYM
9429#define TARGET_BIG_SYM aarch64_elfNN_be_cloudabi_vec
9430#undef TARGET_BIG_NAME
9431#define TARGET_BIG_NAME "elfNN-bigaarch64-cloudabi"
9432
9433#undef ELF_OSABI
9434#define ELF_OSABI ELFOSABI_CLOUDABI
9435
9436#undef elfNN_bed
9437#define elfNN_bed elfNN_aarch64_cloudabi_bed
9438
9439#include "elfNN-target.h"
GDB Binutils - Deliverables
This page took 0.920697 seconds and 4 git commands to generate.